-- Logs begin at Wed 2022-08-24 11:53:48 UTC, end at Wed 2022-08-24 12:52:46 UTC. -- Aug 24 12:24:15.842948 dv-cinder-846054-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 12:24:15.853099 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 12:24:15 2022] *** Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: nodename: dv-cinder-846054-1-iscsi Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: machine: x86_64 Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: clock source: unix Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: pcre jit disabled Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: detected number of CPU cores: 4 Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: current working directory: / Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: detected binary path: /usr/bin/uwsgi-core Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: your processes number limit is 47680 Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: your memory page size is 4096 bytes Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: detected max file descriptor number: 2048 Aug 24 12:24:15.854771 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: lock engine: pthread robust mutexes Aug 24 12:24:15.855754 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: thunder lock: enabled Aug 24 12:24:15.855754 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 12:24:15.855754 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 12:24:15.893798 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: Python main interpreter initialized at 0x55cacbf0c9c0 Aug 24 12:24:15.893798 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: python threads support enabled Aug 24 12:24:15.893798 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: your server socket listen backlog is limited to 100 connections Aug 24 12:24:15.893798 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: your mercy for graceful operations on workers is 90 seconds Aug 24 12:24:15.894200 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 12:24:15.894200 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: *** Operational MODE: preforking *** Aug 24 12:24:15.894448 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: *** uWSGI is running in multiple interpreter mode *** Aug 24 12:24:15.894448 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: spawned uWSGI master process (pid: 105625) Aug 24 12:24:15.894637 dv-cinder-846054-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 12:24:15.895426 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: spawned uWSGI worker 1 (pid: 105626, cores: 1) Aug 24 12:24:15.895540 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: spawned uWSGI worker 2 (pid: 105627, cores: 1) Aug 24 12:24:15.895690 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 12:24:16.543457 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:24:16.544102 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:24:17.611971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:24:17.611971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: from cryptography.utils import int_from_bytes Aug 24 12:24:17.612621 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:24:17.612621 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: from cryptography.utils import int_from_bytes Aug 24 12:24:17.613054 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:24:17.613054 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: from cryptography.utils import int_from_bytes Aug 24 12:24:17.613179 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:24:17.613179 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: from cryptography.utils import int_from_bytes Aug 24 12:24:20.081399 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:24:20.082070 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:24:20.082184 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:24:20.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:24:20.082746 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:24:20.083126 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.083447 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.083767 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.084078 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.084401 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.084704 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.085041 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.085337 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.085657 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.085910 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.086217 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.086533 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846054-1-iscsi {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.086637 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:24:20.087017 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.087100 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:24:20.087177 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.087394 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:24:20.087496 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.087711 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.087813 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:24:20.087980 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:24:20.088075 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.088305 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.088417 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.088589 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.088721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.088976 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.089110 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.089286 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.090476 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.090701 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.090882 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.091065 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.091249 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.091404 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.091620 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.091815 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.091996 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.092150 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.092150 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.092493 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.092729 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.092913 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.093098 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846054-1-iscsi {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.093271 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.093480 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.093635 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.093913 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.094067 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.094067 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846054-1-iscsi {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.094448 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.094632 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.094832 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.094980 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.095156 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.095318 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.095482 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.095647 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.095772 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.095899 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.096055 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.096197 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.096370 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.096567 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.096735 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.096874 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.097003 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.097133 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.097262 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.097387 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.097507 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.097637 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.097769 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.097897 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.098034 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.098191 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.098322 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.098451 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.098572 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.098693 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.098815 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.099027 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.099161 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846054-1-iscsi {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.099291 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.099413 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.099534 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.099655 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.099787 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.099787 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.100025 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.100151 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.100271 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.100401 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.100523 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.100706 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.100863 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.100998 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.101128 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.101258 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.101381 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.101502 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.101631 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.101760 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.101890 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.102013 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.102147 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.102269 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.102396 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.102524 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.102668 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.102804 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.102926 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.103061 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.103183 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.103303 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.103434 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.103562 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.103684 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.103804 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.103929 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.104061 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.104183 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.104302 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.104421 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.104541 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.104681 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.104821 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.104945 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.105065 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.105186 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.105317 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.105444 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.105444 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.105686 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.105815 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.105944 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.106066 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.106202 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.106332 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.106497 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.106700 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.106826 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.106946 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.107079 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.107208 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.107336 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.107457 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.107577 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.107698 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.107827 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.107963 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.108093 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.108221 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.108351 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.108568 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.108720 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.108844 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.108964 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.109111 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.109232 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.109361 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.109489 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.109595 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.109712 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.109832 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.109951 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.110079 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.110199 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.110321 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.110448 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.110643 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.110832 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.110978 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.111113 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.111243 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.111373 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.111505 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.111627 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.111757 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.111878 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.112077 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.112256 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.112388 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.112532 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.112717 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.112843 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.112964 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.113108 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.113231 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.113368 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.113503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.113624 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.113823 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.114002 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.114147 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.114289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.114414 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.114537 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.114664 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.114788 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.114915 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.115045 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.115244 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.115424 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.115578 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.115714 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.115843 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.115978 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.116100 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.116230 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.116351 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.116478 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.116680 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.116908 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.117043 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.117171 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.117293 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.117414 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.117546 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.117675 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.117811 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.117932 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.118063 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.118192 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.118324 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.118446 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.118643 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.118824 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.118957 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.119093 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.119236 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.119367 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.119495 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.119624 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.119777 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.119916 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.120074 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.120204 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.120402 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.120581 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.120759 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.120904 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.121039 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.121169 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.121290 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.121402 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.121553 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.121688 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.121855 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.121995 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.122119 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.122246 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.122454 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.122647 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.122783 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.122911 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.123033 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.123153 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.123298 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.123436 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.123645 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.123824 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.123970 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.124097 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.124246 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.124387 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.124611 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.124816 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.124948 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.125105 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.125352 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.125560 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.125704 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.125830 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.125990 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.126133 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.126279 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.126402 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.126557 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.126726 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.126861 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.127064 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.127209 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.127339 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.127460 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.127591 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.127712 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.127837 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.128008 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.128150 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.128278 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.128468 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.128675 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.128811 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.128956 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:24:20.129084 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.129207 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.129419 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.129651 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.129814 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.129944 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.130066 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.130188 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.130310 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.130437 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.130603 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.130735 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.130940 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.131222 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.131376 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.131504 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.131636 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.131759 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.131881 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.132002 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.132160 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.132300 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.132507 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.132765 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.132911 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.133055 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.133180 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.133302 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.133441 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.133564 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.133684 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.133811 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.133980 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.134144 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.134279 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.134402 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.134607 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.134787 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.134933 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.135076 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.135202 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.135324 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.135483 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.135616 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.135809 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.136003 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.136137 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.136262 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.136392 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.136521 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.136767 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.136918 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.137066 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.137277 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.137404 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.137526 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.137638 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.137767 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.137891 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.138011 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.138175 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.138307 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.138473 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.138604 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.138776 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.138906 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.139107 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.139298 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.139447 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.139574 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.139698 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.139819 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.139940 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.140060 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.140227 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.140360 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.140524 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.140722 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.140936 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.141124 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.141279 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.141521 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.141790 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.141790 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.142057 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.142193 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.142316 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.142444 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.142566 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.142686 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.142814 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.142945 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.143067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.143276 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.143456 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.143602 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.143735 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.143872 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.143998 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.144127 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.144255 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.144402 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.144531 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.144724 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.144856 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.145056 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.145235 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.145380 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.145507 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.145645 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.145775 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.145905 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.146029 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.146229 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.146423 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.146558 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.146682 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.146844 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.146974 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.147097 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.147228 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.147453 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.147587 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.147716 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.147840 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.147960 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.148091 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.148213 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.148334 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.148532 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.148758 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.148886 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.149012 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.149141 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.149262 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.149382 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.149503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.149712 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.149892 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.150024 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.150149 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.150292 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.150418 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.150549 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.150680 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.150841 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.150973 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.151168 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.151349 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.151496 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.151624 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.151747 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.151869 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.151991 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.152121 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.152292 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.152427 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.152596 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.152775 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.152942 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.153109 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.153241 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.153370 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.153566 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.153694 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.153855 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.153995 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.154129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.154258 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.154444 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.154572 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.154777 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.154915 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.155067 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.155268 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.155405 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.155566 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.155694 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.155896 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.156028 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.156148 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.156370 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.156595 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.156799 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.156966 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.157098 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.157220 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.157341 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.157474 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.157685 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.157820 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.157946 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.158073 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.158195 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.158322 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.158452 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.158686 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.158819 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.158941 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.159060 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.159188 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.159319 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.159499 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.159629 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.159799 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.159926 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.160124 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.160254 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.160424 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.160561 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.160773 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.160904 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.161095 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.161225 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.161403 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.161532 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.161713 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.161856 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.162024 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.162149 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.162290 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.162423 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.162588 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.162714 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.162889 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.163014 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.163192 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.163316 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.163492 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.163626 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.163795 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.163920 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.164093 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.164216 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.164398 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.164530 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.164713 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.164838 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.165022 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.165147 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.165320 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.165453 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.165625 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.165748 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.165915 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.166040 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.166218 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.166351 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.166524 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.166648 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.166841 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.167001 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.167129 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.167261 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.167439 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.167565 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.167768 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.167899 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.168036 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.168158 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.168316 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.168442 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.168614 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.168790 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.168924 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.169049 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.169223 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.169355 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.169517 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.169641 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.169817 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.169942 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.170121 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.170244 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.170413 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.170537 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.170712 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.170858 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.171020 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.171130 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.171299 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.171435 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.171599 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.171724 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.171924 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.172052 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.172324 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.172618 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.172771 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.172895 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.173015 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.173148 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.173280 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.173411 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.173532 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.173660 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.173824 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.173950 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.174123 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.174260 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.174421 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.174546 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.174716 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.174842 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.175008 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.175134 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.175309 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.175435 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.175611 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.175735 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.175909 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.176035 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.176203 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.176327 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.176494 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.176625 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.176823 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.176951 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.177121 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.177253 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.177382 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.177504 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.177676 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.177816 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.178021 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.178147 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.178267 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.178397 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.178551 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.178688 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.178858 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.178983 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.179160 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.179301 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.179452 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.179577 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.179743 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.179869 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.180042 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.180174 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.180334 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.180457 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.180626 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.180785 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.180940 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.181074 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.181233 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.181365 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.181538 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.181664 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.181841 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.181976 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.182130 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.182247 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.182427 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.182551 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.182730 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.182855 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.183035 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.183296 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.183421 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.183619 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.183819 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.183943 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.184063 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.184208 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.184332 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.184507 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.184662 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.184828 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.184952 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.185128 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.185252 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.185427 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.185561 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.185724 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.185849 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.186023 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.186158 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.186333 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.186465 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.186627 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.186754 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.186925 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.187049 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.187208 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.187340 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.187524 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.187712 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.187939 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.188147 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.188272 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.188402 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.188534 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.188714 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.188839 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.189024 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.189148 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.189321 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.189456 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.189619 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.189745 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.189927 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.190044 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.190224 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.190375 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.190532 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.190693 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.190819 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.191013 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.191146 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.191340 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.191474 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.191635 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.191761 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.191936 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.192061 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.192231 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.192357 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.192524 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.192672 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.192851 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.192991 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.193140 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.193266 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.193433 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.193558 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.193727 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.193862 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.194025 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.194150 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.194318 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.194443 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.194612 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.194747 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.194905 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.195030 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.195198 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.195324 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.195505 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.195631 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.195801 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.195933 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.196104 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.196229 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.196401 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.196527 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.196733 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.196861 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.197034 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.197175 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.197348 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.197474 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.197594 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.197714 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.197885 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.198010 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.198222 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.198699 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.198830 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.198953 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.199121 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.199255 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.199459 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.199604 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.199779 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.199911 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.200072 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.200204 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.200367 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.200493 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.200700 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.200828 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.200985 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.201124 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.201287 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.201411 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.201583 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.201709 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.201892 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.202026 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.202190 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.202315 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.202488 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.202615 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.202784 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.202912 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.203086 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.203231 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.203414 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.203538 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.203772 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.203904 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.204064 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.204189 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.204360 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.204477 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.204665 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.204794 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.204980 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.205105 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.205283 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.205408 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.205575 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.205702 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.205867 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.205992 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.206165 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.206299 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.206460 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.206585 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.206750 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.206876 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.207049 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.207254 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.207413 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.207536 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.207656 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.207776 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.207897 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.208032 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.208186 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.208392 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.208525 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.208712 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.208835 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.208972 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.209095 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.209214 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.209335 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.209455 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.209626 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.209760 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.209921 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.210047 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.210210 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.210334 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.210500 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.210629 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.210796 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.210921 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.211088 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.211212 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.211378 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.211504 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.211675 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.211800 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.211981 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.212107 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.212281 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.212414 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.212573 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.212717 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.212895 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.213031 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.213188 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.213313 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.213480 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.213605 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.213771 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.213905 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.214062 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.214191 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.214349 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.214475 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.214640 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.214774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.214929 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.215053 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.215218 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.215351 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.215510 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.215644 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.215819 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.215944 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.216112 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.216248 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.216403 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.216536 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.216709 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.216845 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.216995 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.217121 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.217325 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.217487 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.217610 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.217729 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.217920 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.218055 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.218224 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.218351 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.218553 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.218676 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.218888 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.219016 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.219195 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.219322 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.219498 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.219624 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.219802 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.219929 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.220107 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.220243 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.220411 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.220529 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.220747 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.220887 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.221054 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.221187 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.221353 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.221488 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.221655 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.221791 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.221958 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.222083 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.222257 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.222382 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.222572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.222706 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.222871 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.223005 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.223167 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.223295 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.223467 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.223603 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.223762 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.223885 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.224061 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.224186 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.224355 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.224479 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.224692 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.224820 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.224981 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.225107 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.225282 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.225408 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.225581 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.225707 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.225882 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.226007 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.226184 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.226311 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.226484 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.226608 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.226783 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.226907 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.227078 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.227205 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.227375 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.227547 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.227679 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.227856 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.227988 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.228110 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.228238 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.228367 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.228605 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.228772 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.228897 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.229018 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.229139 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.229258 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.229423 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.229561 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.229721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.229845 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.230012 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.230137 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.230385 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.230517 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.230698 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.230823 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.230994 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.231127 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.231284 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.231408 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.231582 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.231709 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.231880 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.232006 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.232183 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.232309 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.232485 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.232689 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.232820 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.232975 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.233203 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.233329 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.233502 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.233634 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.233802 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.233946 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.234085 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.234208 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.234397 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.234547 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.234694 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.235185 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.235185 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.235436 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.235559 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.235679 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.235800 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.235931 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.236054 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.236180 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.236301 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.236424 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.236551 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.236708 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.236878 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.237004 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.237187 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.237319 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.237489 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.237656 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.237803 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.237937 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.238149 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.238284 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.238506 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.238652 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.238854 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.238988 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.239111 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.239232 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.239405 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.239529 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.239700 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.239825 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.239997 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.240122 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.240287 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.240412 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.240581 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.240743 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.240902 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.241038 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.241216 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.241340 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.241513 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.241646 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.241812 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.241943 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.242113 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.242237 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.242404 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.242529 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.242696 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.242813 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.242993 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.243127 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.243299 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.243425 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.243600 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.243730 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.243911 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.244046 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.244218 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.244350 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.244533 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.244681 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.244872 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.245078 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.245206 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.245335 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.245460 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.245581 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.245751 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.245884 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.246043 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.246168 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.246333 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.246457 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.246625 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.246752 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.246934 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.247062 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.247227 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.247352 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.247526 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.247692 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.247819 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.247939 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.248106 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.248238 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.248398 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.248524 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.248700 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.248850 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.249040 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.249173 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.249306 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.249428 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.249585 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.249710 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.249886 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.250087 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.250275 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.250404 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.250615 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.250739 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.250917 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.251053 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.251216 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.251341 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.251511 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.251636 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.251809 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.251945 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.252110 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.252241 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.252396 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.252518 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.252714 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.252855 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.253011 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.253137 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.253321 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.253444 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.253620 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.253745 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.253934 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.254060 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.254233 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.254356 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.254529 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.254654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.254828 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.254953 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.255124 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.255249 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.255449 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.255574 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.255741 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.255872 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.256044 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.256175 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.256337 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.256463 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.256635 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.256805 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.256953 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.257095 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.257248 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.257382 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.257539 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.257664 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.257825 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.257958 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.258109 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.258236 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.258399 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.258525 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.258687 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.258825 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.258995 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.259202 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.259336 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.259458 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.259577 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.259772 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.259897 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.260018 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.260139 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.260419 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.260555 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.260730 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.260856 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.261059 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.261186 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.261353 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.261493 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.261664 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.261788 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.261957 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.262081 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.262266 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.262405 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.262572 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.262696 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.262875 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.262999 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.263176 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.263301 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.263481 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.263613 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.263782 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.263908 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.264104 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.264237 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.264424 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.264558 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.264786 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.264914 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.265103 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.265230 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.265411 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.265536 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.265757 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.265885 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.266070 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.266410 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.266535 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.266721 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.266849 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.267023 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.267158 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.267324 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.267455 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.267626 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.267759 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.267925 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.268049 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.268218 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.268337 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.268516 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.268674 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.268844 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.268969 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.269147 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.269352 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.269477 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.269613 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.269738 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.269866 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.270030 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.270155 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.270336 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.270475 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.270652 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.270778 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.270962 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.271085 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.271269 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.271395 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.271572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.271704 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.271879 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.272003 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.272188 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.272313 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.272531 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.272705 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.272842 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.273041 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.273157 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.273332 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.273466 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.273657 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.273782 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.273974 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.274100 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.274284 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.274410 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.274583 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.274707 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.274885 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.275022 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.275185 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.275311 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.275481 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.275605 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.275780 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.275905 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.276078 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.276202 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.276374 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.276508 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.276707 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.276837 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.277014 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.277141 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.277311 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.277445 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.277610 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.277742 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.277938 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.278067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.278415 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.278552 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.278721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.278850 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.279040 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.279166 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.279358 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.279500 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.279668 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.279803 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.279970 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.280252 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.280361 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.280558 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.280676 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.280884 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.280979 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.281180 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.281343 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.281660 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.281761 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.281964 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.282061 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.282259 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.282371 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.282575 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.282671 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.282877 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.282973 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.283173 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.283324 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.283480 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.283613 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.283775 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.283900 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.284077 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.284294 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.284423 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.284633 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.284790 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.284960 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.285104 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.285276 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.285401 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.285574 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.285699 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.285878 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.286013 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.286171 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.286295 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.286465 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.286590 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.286764 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.286884 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.287057 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.287189 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.287357 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.287481 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.287654 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.287780 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.287942 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.288101 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.288224 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.288344 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.288522 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.288676 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.288843 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.288979 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.289134 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.289271 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.289503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.289638 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.289761 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.289880 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.290001 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.290136 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.290298 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.290424 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.290591 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.290727 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.290884 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.291023 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.291175 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.291299 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.291464 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.291589 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.291755 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.291895 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.292047 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.292173 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.292343 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.292469 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.292641 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.292952 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.293078 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.293251 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.293378 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.293543 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.293677 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.293839 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.293967 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.294130 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.294256 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.294427 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.294562 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.294717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.294842 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.295024 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.295157 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.295316 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.295451 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.295650 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.295775 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.295952 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.296083 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.296248 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.296380 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.296547 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.296690 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.296893 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.297072 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.297210 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.297332 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.297493 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.297685 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.297810 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.297998 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.298189 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.298373 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.298499 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.298674 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.298822 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.298975 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.299132 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.299270 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.299453 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.299600 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.299790 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.299915 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.300047 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.300171 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.300332 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.300464 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.300622 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.300785 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.300956 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.301082 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.301257 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.301386 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.301557 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.301762 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.301887 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.302009 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.302148 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.302297 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.302424 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.302555 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.302711 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.302837 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.303011 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.303136 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.303310 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.303437 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.303608 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.303742 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.303904 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.304100 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.304233 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.304408 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.304533 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.304746 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.304874 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.305063 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.305204 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.305363 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.305500 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.305674 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.305798 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.305987 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.306118 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.306288 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.306413 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.306588 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.306712 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.306889 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.307014 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.307186 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.307318 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.307484 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.307610 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.307782 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.307917 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.308081 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.308251 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.308377 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.308507 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.308706 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.308837 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.309010 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.309138 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.309303 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.309437 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.309612 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.309737 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.309949 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.310075 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.310203 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.310334 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.310457 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.310591 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.310760 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.310886 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.311059 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.311194 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.311355 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.311484 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.311651 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.311778 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.311950 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.312077 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.312251 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.312378 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.312591 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.312896 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.313158 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.313290 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.313411 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.313541 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.313663 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.313786 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.313973 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.314101 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.314268 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.314394 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.314562 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.314698 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.314860 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.314990 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.315159 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.315286 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.315453 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.315587 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.315745 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.315872 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.316032 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.316157 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.316323 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.316458 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.316621 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.316761 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.316939 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.317067 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.317234 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.317370 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.317530 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.317656 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.317824 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.317952 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.318123 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.318290 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.318415 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.318537 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.318691 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.318829 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.318982 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.319109 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.319273 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.319399 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.319564 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.319697 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.319857 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.320064 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.320190 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.320312 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.320433 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.320554 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.320719 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.320851 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.321008 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.321144 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.321299 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.321438 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.321588 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.321721 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.321905 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.322033 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.322228 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.322363 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.322530 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.322656 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.322840 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.322974 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.323140 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.323614 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.323789 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.323915 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.324088 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.324214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.324396 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.324529 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.324710 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.324834 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.325015 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.325139 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.325312 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.325440 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.325611 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.325747 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.325916 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.326040 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.326215 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.326342 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.326510 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.326635 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.326807 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.326941 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.327103 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.327229 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.327403 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.327528 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.327715 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.327849 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.328014 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.328180 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.328400 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.328575 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.328717 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.328846 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.329084 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.329209 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.329394 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.329527 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.329716 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.329916 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.330059 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.330248 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.330372 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.330495 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.330630 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.330753 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.330873 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.330993 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.331114 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:24:20.331234 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.331456 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.331756 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.332062 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.332364 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.332688 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.332999 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.333301 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.333614 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.333928 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.334225 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.334538 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.334852 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.335187 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.335487 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.335817 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.336134 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.336436 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.336762 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.337058 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:24:20.337310 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:24:20.490878 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO dbcounter [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Registered counter for database nova_api Aug 24 12:24:20.495646 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO dbcounter [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Registered counter for database nova_api Aug 24 12:24:20.512250 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_db.sqlalchemy.engines [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:20.515595 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_db.sqlalchemy.engines [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:20.519355 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writer thread running {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:20.522514 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writer thread running {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:20.575524 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.context [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1(cell1) {{(pid=105626) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:24:20.578838 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.context [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1(cell1) {{(pid=105627) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:24:20.579590 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:24:20.580069 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:24:20.581654 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:24:20.582386 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:24:20.582674 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:24:20.582847 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:24:20.583142 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:24:20.584799 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:24:20.584914 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:24:20.585414 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:24:20.585848 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:24:20.586884 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO dbcounter [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Registered counter for database nova_cell0 Aug 24 12:24:20.587856 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:24:20.589885 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO dbcounter [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Registered counter for database nova_cell0 Aug 24 12:24:20.592485 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO dbcounter [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Registered counter for database nova_cell1 Aug 24 12:24:20.595558 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO dbcounter [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Registered counter for database nova_cell1 Aug 24 12:24:20.600448 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_db.sqlalchemy.engines [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:20.602341 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_db.sqlalchemy.engines [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:20.604986 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_db.sqlalchemy.engines [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:20.606154 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writer thread running {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:20.607805 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_db.sqlalchemy.engines [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:20.615471 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writer thread running {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:20.745641 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writer thread running {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:20.752528 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writer thread running {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:20.754410 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO dbcounter [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Registered counter for database nova_cell0 Aug 24 12:24:20.762272 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_db.sqlalchemy.engines [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:20.762931 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO dbcounter [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Registered counter for database nova_cell0 Aug 24 12:24:20.768391 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writer thread running {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:20.773503 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG oslo_db.sqlalchemy.engines [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:24:20.778975 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writer thread running {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:24:21.106057 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: WARNING keystonemiddleware.auth_token [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:24:21.109986 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: WARNING keystonemiddleware.auth_token [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:24:21.113686 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: WARNING keystonemiddleware.auth_token [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:24:21.117283 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: WARNING keystonemiddleware.auth_token [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:24:21.460133 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: WARNING keystonemiddleware.auth_token [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:24:21.461865 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: WARNING keystonemiddleware.auth_token [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:24:21.466065 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: WARNING keystonemiddleware.auth_token [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:24:21.467794 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: WARNING keystonemiddleware.auth_token [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:24:21.472387 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cacbf0c9c0 pid: 105627 (default app) Aug 24 12:24:21.473316 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cacbf0c9c0 pid: 105626 (default app) Aug 24 12:24:21.474524 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:24:21.475743 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-515da361-f0b8-4ed8-b178-dc8a655176c6 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001788 Aug 24 12:24:21.476157 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Wed Aug 24 12:24:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:40.310637 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:40.311805 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Aug 24 12:25:40.312669 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:25:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:40.324532 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:SELECT=3 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:40.325686 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_cell1:SELECT=3 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:40.326985 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_cell0:SELECT=3 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:40.327808 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:41.155876 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-de9a5333-3791-40b7-923b-1a8322fc6983 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:41.187614 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-de9a5333-3791-40b7-923b-1a8322fc6983 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.868403 Aug 24 12:25:41.192690 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 2/3] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 24 12:25:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:43.548843 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:43.562645 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-c919c355-9346-4212-972b-0e450c68b3b2 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.014169 Aug 24 12:25:43.562645 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 2/4] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:44.012233 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-49c43f36-85b6-463d-ab0f-521701f6cf26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "ram": 256, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:44.031986 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:25:44.031986 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: warnings.warn(msg) Aug 24 12:25:44.061967 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-49c43f36-85b6-463d-ab0f-521701f6cf26 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.492690 Aug 24 12:25:44.062608 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 3/5] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:25:44.282412 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-3487e774-3fcc-4d23-aa80-64f06ec53f6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:44.286756 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:25:44.286756 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: warnings.warn(msg) Aug 24 12:25:44.306852 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_api:SELECT=3 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:44.307896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_cell1:SELECT=3 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:44.308884 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_cell0:SELECT=3 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:44.309742 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:25:44.347721 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-3487e774-3fcc-4d23-aa80-64f06ec53f6f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276071 Aug 24 12:25:44.348385 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 3/6] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:46.737497 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-49c43f36-85b6-463d-ab0f-521701f6cf26 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:46.738537 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-49c43f36-85b6-463d-ab0f-521701f6cf26 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Aug 24 12:25:46.739173 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 4/7] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:25:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:47.412019 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-8cf96f5f-adb3-405a-b6ff-fb54eb3cefe1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 5, "ram": 512}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:47.431349 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:25:47.431349 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: warnings.warn(msg) Aug 24 12:25:47.456187 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-8cf96f5f-adb3-405a-b6ff-fb54eb3cefe1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710016 Aug 24 12:25:47.456983 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 4/8] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:25:47.469244 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-e2affd8f-30c2-4522-b6e1-afdf3a29cfef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:47.472041 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:25:47.472041 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: warnings.warn(msg) Aug 24 12:25:47.506073 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-e2affd8f-30c2-4522-b6e1-afdf3a29cfef admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040579 Aug 24 12:25:47.506794 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 5/9] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:49.819829 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-8cf96f5f-adb3-405a-b6ff-fb54eb3cefe1 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:49.820858 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-8cf96f5f-adb3-405a-b6ff-fb54eb3cefe1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 24 12:25:49.821256 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:25:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:50.191443 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-6a3d55a3-5d9e-4573-9c3e-dc3ad8936e82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "disk": 10, "swap": 0, "vcpus": 1}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:50.212229 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-6a3d55a3-5d9e-4573-9c3e-dc3ad8936e82 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.384629 Aug 24 12:25:50.212836 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 6/11] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:25:50.224952 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-37c5645a-f32f-4296-ad55-858a827ff9f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:50.250676 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-37c5645a-f32f-4296-ad55-858a827ff9f6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029275 Aug 24 12:25:50.251398 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 6/12] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:52.592265 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-6a3d55a3-5d9e-4573-9c3e-dc3ad8936e82 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:52.593621 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-6a3d55a3-5d9e-4573-9c3e-dc3ad8936e82 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001816 Aug 24 12:25:52.594168 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 7/13] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:53.188771 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-e700a145-0000-49f8-a277-63d17b3fa730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3"}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:53.210399 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-e700a145-0000-49f8-a277-63d17b3fa730 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.609975 Aug 24 12:25:53.211582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 7/14] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:25:53.223341 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-049fdd56-4dea-411e-852a-5366b1e9c57e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:53.248300 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-049fdd56-4dea-411e-852a-5366b1e9c57e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028642 Aug 24 12:25:53.249241 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 8/15] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:55.605031 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-e700a145-0000-49f8-a277-63d17b3fa730 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:55.606078 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-e700a145-0000-49f8-a277-63d17b3fa730 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 24 12:25:55.606630 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 8/16] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:25:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:56.067697 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-bdf2954d-ab2a-4d1a-bf40-b15f3a2b2e32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "disk": 20}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:56.087956 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-bdf2954d-ab2a-4d1a-bf40-b15f3a2b2e32 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475002 Aug 24 12:25:56.088732 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 9/17] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:25:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:25:56.101246 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-21c00e4a-f31c-408d-a568-8770f4ba9b15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:25:56.129436 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-21c00e4a-f31c-408d-a568-8770f4ba9b15 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032274 Aug 24 12:25:56.130417 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 9/18] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 12:25:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:25:58.692455 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-bdf2954d-ab2a-4d1a-bf40-b15f3a2b2e32 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:58.693556 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-bdf2954d-ab2a-4d1a-bf40-b15f3a2b2e32 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001680 Aug 24 12:25:58.694029 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 10/19] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:25:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:25:59.135839 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-d9171852-35cb-496c-86ae-219b135f6dcb admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:25:59.160301 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-d9171852-35cb-496c-86ae-219b135f6dcb admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458557 Aug 24 12:25:59.160878 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 10/20] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 24 12:25:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:01.634155 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-bdf2954d-ab2a-4d1a-bf40-b15f3a2b2e32 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:01.635683 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-bdf2954d-ab2a-4d1a-bf40-b15f3a2b2e32 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Aug 24 12:26:01.636137 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 11/21] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:02.086061 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-be3bdae3-59ea-4edc-80cf-3a6e292d4b22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:02.108324 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-be3bdae3-59ea-4edc-80cf-3a6e292d4b22 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.465780 Aug 24 12:26:02.108913 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 11/22] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:26:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:02.122319 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-c6567b8d-7ac6-48f1-9aa1-20018f2c5fdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:02.152472 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-c6567b8d-7ac6-48f1-9aa1-20018f2c5fdd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034638 Aug 24 12:26:02.153081 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 12/23] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 12:26:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:26:04.516603 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-be3bdae3-59ea-4edc-80cf-3a6e292d4b22 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:04.518381 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-be3bdae3-59ea-4edc-80cf-3a6e292d4b22 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002837 Aug 24 12:26:04.518788 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:04.927854 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-a0a916ae-60b7-4c94-a339-79b304787c59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "vcpus": 1, "name": "m1.small"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:04.949343 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-a0a916ae-60b7-4c94-a339-79b304787c59 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424281 Aug 24 12:26:04.950002 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 13/25] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:26:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:04.961794 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-dfbbe406-2264-41bf-b80c-faa99cfd1eba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:04.990190 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-dfbbe406-2264-41bf-b80c-faa99cfd1eba admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031972 Aug 24 12:26:04.990760 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 13/26] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 12:26:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:26:07.374295 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-a0a916ae-60b7-4c94-a339-79b304787c59 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:07.375662 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-a0a916ae-60b7-4c94-a339-79b304787c59 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Aug 24 12:26:07.376170 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:26:07.818081 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-15bd7199-c663-49b1-aaa2-56722fc825ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "id": "3"}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:07.838573 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-15bd7199-c663-49b1-aaa2-56722fc825ca admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.456080 Aug 24 12:26:07.839165 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 14/28] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:26:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:07.851227 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-5cccd45a-b7ce-4b54-a65a-11501997ed8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:07.879765 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-5cccd45a-b7ce-4b54-a65a-11501997ed8c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032094 Aug 24 12:26:07.880334 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 15/29] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 12:26:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:26:10.419026 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-15bd7199-c663-49b1-aaa2-56722fc825ca admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:10.419942 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-15bd7199-c663-49b1-aaa2-56722fc825ca admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 24 12:26:10.420533 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 15/30] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:10.877436 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-a7f3e94e-c156-465e-8cf4-44c74c84b99c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:10.884457 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:26:10.900266 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-a7f3e94e-c156-465e-8cf4-44c74c84b99c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473678 Aug 24 12:26:10.901145 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 16/31] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:26:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:10.913389 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-27209a61-266a-4d57-9bb9-ee801bd69ac5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:10.942944 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-27209a61-266a-4d57-9bb9-ee801bd69ac5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033632 Aug 24 12:26:10.943560 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 16/32] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 12:26:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:26:13.396292 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-a7f3e94e-c156-465e-8cf4-44c74c84b99c admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:13.397351 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-a7f3e94e-c156-465e-8cf4-44c74c84b99c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 24 12:26:13.399395 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 17/33] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:13.842372 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-13cb189b-418c-420d-87a8-9b138c8115fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:13.865856 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-13cb189b-418c-420d-87a8-9b138c8115fe admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461146 Aug 24 12:26:13.866607 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 17/34] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 12:26:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:13.879426 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-e6c6db30-2416-4164-9d25-0388d634d954 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:13.909126 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-e6c6db30-2416-4164-9d25-0388d634d954 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034071 Aug 24 12:26:13.909746 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 18/35] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 12:26:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:26:32.281400 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-13cb189b-418c-420d-87a8-9b138c8115fe admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:32.282983 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-13cb189b-418c-420d-87a8-9b138c8115fe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002429 Aug 24 12:26:32.283508 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 18/36] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:32.297757 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:26:32.714079 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-194a4f68-0c96-42c5-855f-cebb4c3b9531 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:32.737037 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-194a4f68-0c96-42c5-855f-cebb4c3b9531 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.446632 Aug 24 12:26:32.737579 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 19/37] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 24 12:26:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:33.831977 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-13cb189b-418c-420d-87a8-9b138c8115fe admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:33.833011 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-13cb189b-418c-420d-87a8-9b138c8115fe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 12:26:33.833414 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 19/38] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:34.404180 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4cbc6764-4a9f-4fe1-b39d-adeb3340d2ab admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:34.412419 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.wsgi [None req-4cbc6764-4a9f-4fe1-b39d-adeb3340d2ab admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4cbc6764-4a9f-4fe1-b39d-adeb3340d2ab admin admin] Request method failure captured: Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Accept: application/json Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Accept-Encoding: gzip, deflate Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Connection: keep-alive Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Content-Length: 0 Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Host: 10.222.0.27 Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Openstack-System-Scope: None Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: User-Agent: python-novaclient Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Auth-Token: gAAAAABjBhj5srRk4OAcYRsctN08xII8L0fyb-iwQzNQZYzRaUUo3xWaUKVnewBIUGep4rChGC04u5AU4Ur3fKQOlmPSLp-mydIMYpkpOLCZvYic2WIqwljRwV5oMxnuGxv5owHAphoUTq-Ok6mVZZLEO-M2zS7DOIVnY_cNZTJH93QLparmm0w Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Domain-Id: None Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Domain-Name: None Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Identity-Status: Confirmed Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Is-Admin-Project: True Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Domain-Id: default Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Domain-Name: Default Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Name: admin Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Role: admin,reader,member Aug 24 12:26:34.417509 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Roles: admin,reader,member Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}] Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant: admin Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant-Name: admin Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User: admin Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Domain-Id: default Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Domain-Name: Default Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Id: fe15d570e61b4d028bf4767532315b26 Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Name: admin Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: method: > Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: exception: Flavor 42 could not be found. Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: action_args: {'id': '42'} Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:34.419099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:34.420152 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.421592 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4cbc6764-4a9f-4fe1-b39d-adeb3340d2ab admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:34.422901 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4cbc6764-4a9f-4fe1-b39d-adeb3340d2ab admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.448294 Aug 24 12:26:34.422901 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 20/39] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 24 12:26:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:34.428445 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-f4a96a79-481c-49f1-844e-afdbdeed809f admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:34.433304 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:26:34.453246 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-f4a96a79-481c-49f1-844e-afdbdeed809f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028392 Aug 24 12:26:34.453790 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 20/40] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:34.464041 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-1c9af361-cab0-41a0-b562-7ffc50a6a888 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:34.488222 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-1c9af361-cab0-41a0-b562-7ffc50a6a888 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028015 Aug 24 12:26:34.488785 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:34.498725 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-4cc6c0ac-ccc4-4a07-9fd8-f04be644eed2 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:34.505663 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.wsgi [None req-4cc6c0ac-ccc4-4a07-9fd8-f04be644eed2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-4cc6c0ac-ccc4-4a07-9fd8-f04be644eed2 admin admin] Request method failure captured: Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Accept: application/json Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Accept-Encoding: gzip, deflate Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Connection: keep-alive Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Content-Length: 0 Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Host: 10.222.0.27 Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Openstack-System-Scope: None Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: User-Agent: python-novaclient Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Auth-Token: gAAAAABjBhj5srRk4OAcYRsctN08xII8L0fyb-iwQzNQZYzRaUUo3xWaUKVnewBIUGep4rChGC04u5AU4Ur3fKQOlmPSLp-mydIMYpkpOLCZvYic2WIqwljRwV5oMxnuGxv5owHAphoUTq-Ok6mVZZLEO-M2zS7DOIVnY_cNZTJH93QLparmm0w Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Domain-Id: None Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Domain-Name: None Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Identity-Status: Confirmed Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Is-Admin-Project: True Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Domain-Id: default Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Domain-Name: Default Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Name: admin Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Role: admin,reader,member Aug 24 12:26:34.508971 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Roles: admin,reader,member Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}] Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant: admin Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant-Name: admin Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User: admin Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Domain-Id: default Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Domain-Name: Default Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Id: fe15d570e61b4d028bf4767532315b26 Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Name: admin Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: method: > Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: exception: Flavor 42 could not be found. Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: action_args: {'id': '42'} Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:34.510572 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:34.511582 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:34.513129 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-4cc6c0ac-ccc4-4a07-9fd8-f04be644eed2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:34.514274 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-4cc6c0ac-ccc4-4a07-9fd8-f04be644eed2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015749 Aug 24 12:26:34.514274 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 21/42] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 24 12:26:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:35.503297 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-1c9af361-cab0-41a0-b562-7ffc50a6a888 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:35.504297 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-1c9af361-cab0-41a0-b562-7ffc50a6a888 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 12:26:35.504685 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 22/43] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:36.074060 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-014f483e-6372-4335-8746-7fac159a8cb8 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:36.079700 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.wsgi [None req-014f483e-6372-4335-8746-7fac159a8cb8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-014f483e-6372-4335-8746-7fac159a8cb8 admin admin] Request method failure captured: Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Accept: application/json Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Accept-Encoding: gzip, deflate Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Connection: keep-alive Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Content-Length: 0 Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Host: 10.222.0.27 Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Openstack-System-Scope: None Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: User-Agent: python-novaclient Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Auth-Token: gAAAAABjBhj7ULS6Z665j5PjMPOaXsk6drnsJ3ZbEKObPa4W53McSHLhKBp0GXZrrSkDrTK1And9P34ktsaYZzcEBEctSUGNov_0F7vPGLKv69BujuOWG7IptiD1g40cVC6ONHwzFHg6tOEcq_0RcaLX_HrdMHjHa7JxbXRhdWIkzTDWWAGpl-g Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Domain-Id: None Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Domain-Name: None Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Identity-Status: Confirmed Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Is-Admin-Project: True Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Domain-Id: default Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Domain-Name: Default Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Name: admin Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Role: admin,reader,member Aug 24 12:26:36.081214 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Roles: admin,reader,member Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}] Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant: admin Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant-Name: admin Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User: admin Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Domain-Id: default Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Domain-Name: Default Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Id: fe15d570e61b4d028bf4767532315b26 Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Name: admin Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: method: > Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: exception: Flavor 84 could not be found. Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: action_args: {'id': '84'} Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:36.082494 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:36.083289 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.084593 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-014f483e-6372-4335-8746-7fac159a8cb8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:36.085844 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-014f483e-6372-4335-8746-7fac159a8cb8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.441242 Aug 24 12:26:36.085844 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 24 12:26:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:36.092715 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-16992855-2822-4e71-af8a-0b4b0aa42d8f admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:36.107766 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-16992855-2822-4e71-af8a-0b4b0aa42d8f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018836 Aug 24 12:26:36.108320 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 23/45] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:36.119074 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-ece2ce49-c184-40fb-84a8-54ab10bc3f89 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:36.139014 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-ece2ce49-c184-40fb-84a8-54ab10bc3f89 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024131 Aug 24 12:26:36.139577 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:36.153608 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-e55b96b9-6d8a-46ec-b200-b0f13f4c59e3 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:36.159646 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.wsgi [None req-e55b96b9-6d8a-46ec-b200-b0f13f4c59e3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-e55b96b9-6d8a-46ec-b200-b0f13f4c59e3 admin admin] Request method failure captured: Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Accept: application/json Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Accept-Encoding: gzip, deflate Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Connection: keep-alive Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Content-Length: 0 Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Host: 10.222.0.27 Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Openstack-System-Scope: None Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: User-Agent: python-novaclient Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Auth-Token: gAAAAABjBhj7ULS6Z665j5PjMPOaXsk6drnsJ3ZbEKObPa4W53McSHLhKBp0GXZrrSkDrTK1And9P34ktsaYZzcEBEctSUGNov_0F7vPGLKv69BujuOWG7IptiD1g40cVC6ONHwzFHg6tOEcq_0RcaLX_HrdMHjHa7JxbXRhdWIkzTDWWAGpl-g Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Domain-Id: None Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Domain-Name: None Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Identity-Status: Confirmed Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Is-Admin-Project: True Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Domain-Id: default Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Domain-Name: Default Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Name: admin Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Role: admin,reader,member Aug 24 12:26:36.161177 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Roles: admin,reader,member Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}] Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant: admin Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant-Name: admin Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User: admin Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Domain-Id: default Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Domain-Name: Default Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Id: fe15d570e61b4d028bf4767532315b26 Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Name: admin Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: method: > Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: exception: Flavor 84 could not be found. Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: action_args: {'id': '84'} Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:36.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:36.163654 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:36.165067 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-e55b96b9-6d8a-46ec-b200-b0f13f4c59e3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:36.166159 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-e55b96b9-6d8a-46ec-b200-b0f13f4c59e3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015278 Aug 24 12:26:36.166159 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 24/47] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 24 12:26:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:37.157441 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-ece2ce49-c184-40fb-84a8-54ab10bc3f89 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:37.158448 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-ece2ce49-c184-40fb-84a8-54ab10bc3f89 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 12:26:37.158853 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 24/48] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:37.738486 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-1fd7efaa-9db8-4667-bf65-a70b49725483 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:37.746187 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.wsgi [None req-1fd7efaa-9db8-4667-bf65-a70b49725483 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-1fd7efaa-9db8-4667-bf65-a70b49725483 admin admin] Request method failure captured: Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Accept: application/json Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Accept-Encoding: gzip, deflate Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Connection: keep-alive Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Content-Length: 0 Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Host: 10.222.0.27 Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Openstack-System-Scope: None Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: User-Agent: python-novaclient Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Auth-Token: gAAAAABjBhj9XjEsQZNVlnstjsd6tKy8Sh5BaE72qavIV_djgXt7gdfeCm3wL2PMkOwTXl2uMeN0NeWUeJkOyfNysSJAJ5mVo9fy0A4jL-S8q--fmx-kuVJL_okM2ExfW-qiWyT0zRXb2wW_vkQDzmzhoFw_a8-xFe9p8k2NVRu0xoofJcN_HXE Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Domain-Id: None Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Domain-Name: None Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Identity-Status: Confirmed Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Is-Admin-Project: True Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Domain-Id: default Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Domain-Name: Default Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Project-Name: admin Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Role: admin,reader,member Aug 24 12:26:37.748717 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Roles: admin,reader,member Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}] Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant: admin Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-Tenant-Name: admin Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User: admin Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Domain-Id: default Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Domain-Name: Default Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Id: fe15d570e61b4d028bf4767532315b26 Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: X-User-Name: admin Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: method: > Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: exception: Flavor 451 could not be found. Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: action_args: {'id': '451'} Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:37.750191 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:37.751215 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.752468 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-1fd7efaa-9db8-4667-bf65-a70b49725483 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:37.753827 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-1fd7efaa-9db8-4667-bf65-a70b49725483 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.452878 Aug 24 12:26:37.753827 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 25/49] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 12:26:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:37.760456 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-b7a7a7fd-f169-4aae-8d46-a29640c5f057 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:37.775398 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-b7a7a7fd-f169-4aae-8d46-a29640c5f057 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018505 Aug 24 12:26:37.775953 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 25/50] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:37.791072 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:37.807606 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022494 Aug 24 12:26:37.808128 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 26/51] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 12:26:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:26:37.820546 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-65f70cad-b587-44a8-8ba0-5e96afdb9283 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:37.827965 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.wsgi [None req-65f70cad-b587-44a8-8ba0-5e96afdb9283 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-65f70cad-b587-44a8-8ba0-5e96afdb9283 admin admin] Request method failure captured: Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Accept: application/json Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Accept-Encoding: gzip, deflate Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Connection: keep-alive Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Content-Length: 0 Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Host: 10.222.0.27 Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Openstack-Api-Version: compute 2.90 Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Openstack-System-Scope: None Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: User-Agent: python-novaclient Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Auth-Token: gAAAAABjBhj9XjEsQZNVlnstjsd6tKy8Sh5BaE72qavIV_djgXt7gdfeCm3wL2PMkOwTXl2uMeN0NeWUeJkOyfNysSJAJ5mVo9fy0A4jL-S8q--fmx-kuVJL_okM2ExfW-qiWyT0zRXb2wW_vkQDzmzhoFw_a8-xFe9p8k2NVRu0xoofJcN_HXE Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Domain-Id: None Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Domain-Name: None Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Identity-Status: Confirmed Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Is-Admin-Project: True Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Domain-Id: default Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Domain-Name: Default Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Project-Name: admin Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Role: admin,reader,member Aug 24 12:26:37.829503 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Roles: admin,reader,member Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66ac24841ce6483cbf8285ea30e957f8"}]}] Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant: admin Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant-Id: 66ac24841ce6483cbf8285ea30e957f8 Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-Tenant-Name: admin Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User: admin Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Domain-Id: default Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Domain-Name: Default Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Id: fe15d570e61b4d028bf4767532315b26 Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: X-User-Name: admin Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: method: > Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: exception: Flavor 451 could not be found. Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: action_args: {'id': '451'} Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:26:37.830896 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:37.832699 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: ERROR nova.api.openstack.wsgi Aug 24 12:26:37.833774 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-65f70cad-b587-44a8-8ba0-5e96afdb9283 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:26:37.834775 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-65f70cad-b587-44a8-8ba0-5e96afdb9283 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016557 Aug 24 12:26:37.834775 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 26/52] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 12:26:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 12:26:38.804520 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:38.805566 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 24 12:26:38.805958 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:39.394574 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-4c6470a0-1c81-446b-b635-8467b4b4d54a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:39.423159 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-4c6470a0-1c81-446b-b635-8467b4b4d54a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.473731 Aug 24 12:26:39.423680 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 27/54] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 24 12:26:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:40.404294 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:40.405359 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 24 12:26:40.405738 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:40.988070 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-61e8dce5-3b18-4adf-a953-52c9538a80d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:41.011184 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-61e8dce5-3b18-4adf-a953-52c9538a80d1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.466212 Aug 24 12:26:41.011795 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 28/56] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 24 12:26:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:42.007167 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:42.008168 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 24 12:26:42.008532 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 29/57] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:42.577787 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-580342a8-1eef-4e8d-a69e-eb4aff921624 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:42.600584 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-580342a8-1eef-4e8d-a69e-eb4aff921624 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.453050 Aug 24 12:26:42.601246 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 29/58] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 24 12:26:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:43.607021 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:43.608028 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 24 12:26:43.608415 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 30/59] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:44.175167 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-5c00ded0-bef1-4a09-b26c-d349ad79bbbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:26:44.201762 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-5c00ded0-bef1-4a09-b26c-d349ad79bbbe admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.449296 Aug 24 12:26:44.202313 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 30/60] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 24 12:26:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:26:45.194040 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:45.195051 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 12:26:45.195440 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 31/61] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:26:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:26:45.786030 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-cc6d2547-4bc5-4821-a79b-72656f8173e6 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:26:45.807208 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-cc6d2547-4bc5-4821-a79b-72656f8173e6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.472989 Aug 24 12:26:45.807733 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 31/62] 10.222.0.27 () {60 vars in 1202 bytes} [Wed Aug 24 12:26:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:27:40.568156 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:40.569506 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-8c232c5f-014d-48d4-99b8-fba8cc114638 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Aug 24 12:27:40.569903 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 32/63] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 12:27:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:27:40.584383 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:27:41.018634 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-dd173b90-c961-462a-b945-e13673a7a841 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:41.040515 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-dd173b90-c961-462a-b945-e13673a7a841 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.463793 Aug 24 12:27:41.041090 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 32/64] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 24 12:27:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:27:41.065046 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:SELECT=14 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:27:41.070747 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-122a4088-1f46-490e-a5d7-2b10a02bbf87 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:41.078642 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-122a4088-1f46-490e-a5d7-2b10a02bbf87 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016164 Aug 24 12:27:41.079457 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 33/65] 10.222.0.27 () {60 vars in 1283 bytes} [Wed Aug 24 12:27:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:27:41.091348 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-f987c2e0-b0a2-4636-8316-47a5d8691902 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:41.099127 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-f987c2e0-b0a2-4636-8316-47a5d8691902 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011420 Aug 24 12:27:41.099695 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 33/66] 10.222.0.27 () {60 vars in 1286 bytes} [Wed Aug 24 12:27:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:27:41.113153 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:41.120872 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013151 Aug 24 12:27:41.121391 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 34/67] 10.222.0.27 () {60 vars in 1286 bytes} [Wed Aug 24 12:27:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:27:41.133443 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-69afa6fd-0549-41f1-b10a-8f5fe5c6ba39 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:27:41.141549 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-69afa6fd-0549-41f1-b10a-8f5fe5c6ba39 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012305 Aug 24 12:27:41.142068 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 34/68] 10.222.0.27 () {60 vars in 1283 bytes} [Wed Aug 24 12:27:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:30:42.579780 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:42.581460 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002338 Aug 24 12:30:42.582099 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 35/69] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:42.727039 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_api:SELECT=6 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:42.911015 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-fcda43c4-5ed2-4c52-9a6e-5147bcdb0e6b admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:42.914643 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:30:42.914643 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: warnings.warn(msg) Aug 24 12:30:42.916377 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-fcda43c4-5ed2-4c52-9a6e-5147bcdb0e6b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:42.917136 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-fcda43c4-5ed2-4c52-9a6e-5147bcdb0e6b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:42.917817 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-fcda43c4-5ed2-4c52-9a6e-5147bcdb0e6b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.918967 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-fcda43c4-5ed2-4c52-9a6e-5147bcdb0e6b admin admin] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:42.919589 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-fcda43c4-5ed2-4c52-9a6e-5147bcdb0e6b admin admin] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:42.920260 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-fcda43c4-5ed2-4c52-9a6e-5147bcdb0e6b admin admin] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:42.955344 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-fcda43c4-5ed2-4c52-9a6e-5147bcdb0e6b admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.230597 Aug 24 12:30:42.955912 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 35/70] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 12:30:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:30:43.823974 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:43.825017 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 24 12:30:43.825489 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:44.040876 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-bbba14ed-969f-41dd-830c-3b7f1467cb1c admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:44.043282 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:30:44.043282 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: warnings.warn(msg) Aug 24 12:30:44.044396 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-bbba14ed-969f-41dd-830c-3b7f1467cb1c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:44.044903 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-bbba14ed-969f-41dd-830c-3b7f1467cb1c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:44.045333 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-bbba14ed-969f-41dd-830c-3b7f1467cb1c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.046046 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-bbba14ed-969f-41dd-830c-3b7f1467cb1c admin admin] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:44.046491 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-bbba14ed-969f-41dd-830c-3b7f1467cb1c admin admin] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:44.046903 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-bbba14ed-969f-41dd-830c-3b7f1467cb1c admin admin] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:44.068860 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-bbba14ed-969f-41dd-830c-3b7f1467cb1c admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.089269 Aug 24 12:30:44.069447 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 36/72] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 12:30:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:30:55.354758 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:55.355771 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 24 12:30:55.356138 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 37/73] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:30:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:55.502537 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_cell0:SELECT=4 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:55.503401 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_cell1:SELECT=4 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:55.504012 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG dbcounter [-] [105626] Writing DB stats nova_api:SELECT=8 {{(pid=105626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:30:55.568603 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-44de218d-5519-42d2-ad0a-72ddf823d445 admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:55.572713 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:30:55.572713 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: warnings.warn(msg) Aug 24 12:30:55.574354 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-44de218d-5519-42d2-ad0a-72ddf823d445 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:55.575027 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-44de218d-5519-42d2-ad0a-72ddf823d445 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:55.575633 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-44de218d-5519-42d2-ad0a-72ddf823d445 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:55.576716 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-44de218d-5519-42d2-ad0a-72ddf823d445 admin admin] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:55.577352 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-44de218d-5519-42d2-ad0a-72ddf823d445 admin admin] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:55.577928 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-44de218d-5519-42d2-ad0a-72ddf823d445 admin admin] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:55.607852 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-44de218d-5519-42d2-ad0a-72ddf823d445 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.111973 Aug 24 12:30:55.608392 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 37/74] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 12:30:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:30:56.457701 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:56.458737 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-5d376763-3139-45a6-91fd-8e8b87a29db6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 12:30:56.459129 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 38/75] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 12:30:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:30:56.658348 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG nova.api.openstack.wsgi [None req-e050d57a-5a37-46be-90f6-24fa7589749f admin admin] Calling method '>' {{(pid=105626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:30:56.660864 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 12:30:56.660864 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: warnings.warn(msg) Aug 24 12:30:56.661908 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-e050d57a-5a37-46be-90f6-24fa7589749f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:56.662373 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-e050d57a-5a37-46be-90f6-24fa7589749f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:56.662796 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-e050d57a-5a37-46be-90f6-24fa7589749f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:56.663504 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-e050d57a-5a37-46be-90f6-24fa7589749f admin admin] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:30:56.663941 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-e050d57a-5a37-46be-90f6-24fa7589749f admin admin] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:30:56.664349 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: DEBUG oslo_concurrency.lockutils [None req-e050d57a-5a37-46be-90f6-24fa7589749f admin admin] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:30:56.686017 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: INFO nova.api.openstack.requestlog [None req-e050d57a-5a37-46be-90f6-24fa7589749f admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088197 Aug 24 12:30:56.686567 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: [pid: 105626|app: 0|req: 38/76] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 12:30:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:31:54.209042 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: Wed Aug 24 12:31:54 2022 - graceful shutdown triggered... Aug 24 12:31:54.210173 dv-cinder-846054-1-iscsi devstack@n-api.service[105626]: Gracefully killing worker 1 (pid: 105626)... Aug 24 12:31:54.209882 dv-cinder-846054-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 12:31:54.211061 dv-cinder-846054-1-iscsi devstack@n-api.service[105627]: Gracefully killing worker 2 (pid: 105627)... Aug 24 12:31:55.210864 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: worker 1 buried after 1 seconds Aug 24 12:31:55.210864 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: worker 2 buried after 1 seconds Aug 24 12:31:55.210864 dv-cinder-846054-1-iscsi devstack@n-api.service[105625]: goodbye to uWSGI. Aug 24 12:31:55.212520 dv-cinder-846054-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 12:31:55.213140 dv-cinder-846054-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 12:31:55.215954 dv-cinder-846054-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 12:31:55.227235 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 12:31:55 2022] *** Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: nodename: dv-cinder-846054-1-iscsi Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: machine: x86_64 Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: clock source: unix Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: pcre jit disabled Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: detected number of CPU cores: 4 Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: current working directory: / Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: detected binary path: /usr/bin/uwsgi-core Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: your processes number limit is 47680 Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: your memory page size is 4096 bytes Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: detected max file descriptor number: 2048 Aug 24 12:31:55.229482 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: lock engine: pthread robust mutexes Aug 24 12:31:55.230382 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: thunder lock: enabled Aug 24 12:31:55.230382 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 12:31:55.230382 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 12:31:55.269683 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: Python main interpreter initialized at 0x55bdac8829c0 Aug 24 12:31:55.269683 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: python threads support enabled Aug 24 12:31:55.269683 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: your server socket listen backlog is limited to 100 connections Aug 24 12:31:55.269683 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: your mercy for graceful operations on workers is 90 seconds Aug 24 12:31:55.270222 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 12:31:55.270222 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: *** Operational MODE: preforking *** Aug 24 12:31:55.270423 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: *** uWSGI is running in multiple interpreter mode *** Aug 24 12:31:55.270588 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: spawned uWSGI master process (pid: 127279) Aug 24 12:31:55.270932 dv-cinder-846054-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 12:31:55.271689 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: spawned uWSGI worker 1 (pid: 127298, cores: 1) Aug 24 12:31:55.272170 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: spawned uWSGI worker 2 (pid: 127299, cores: 1) Aug 24 12:31:55.272446 dv-cinder-846054-1-iscsi devstack@n-api.service[127279]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 12:31:55.927962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:31:55.946888 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 12:31:57.079167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:31:57.079167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: from cryptography.utils import int_from_bytes Aug 24 12:31:57.079818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:31:57.079818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: from cryptography.utils import int_from_bytes Aug 24 12:31:57.105156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:31:57.105156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: from cryptography.utils import int_from_bytes Aug 24 12:31:57.105632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:31:57.105632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: from cryptography.utils import int_from_bytes Aug 24 12:31:59.501258 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:31:59.501890 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:31:59.502086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:31:59.502449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:31:59.502703 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:31:59.503098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.503427 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.503747 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.504077 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.504602 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.504944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.505244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.505568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.505895 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.506144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.506460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.506811 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846054-1-iscsi {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.507116 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.507425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.507738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.508058 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.508363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.508731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.509054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.509686 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.510258 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.510576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.510956 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.511243 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.511615 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.511868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.512190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.512504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.512859 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.513182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.513582 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846054-1-iscsi {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.513901 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.514441 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.514762 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.515198 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.515471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.515770 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.516089 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.516410 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.516820 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.517130 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.517427 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.517745 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.518064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.518365 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.518669 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.518979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.519300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.519664 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.519976 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.520225 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.520531 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.520880 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.521201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.521525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.521777 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.522027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.522344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.522664 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.522972 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.523276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.523581 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.523882 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.524185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.524487 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.524816 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.525119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.525435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.525750 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.526071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.526377 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.526703 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.527109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.527358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.527659 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.528003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.528321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.528626 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.528973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.529290 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.529594 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.529898 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.530203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.530520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.530857 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.531161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.531412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.531713 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.532016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.532334 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.532640 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.532967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.533274 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.533569 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.533875 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.534178 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.534484 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.534785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.535434 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.535750 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.536103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.536408 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.536738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.537063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.537388 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.537699 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.538005 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.538313 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.538621 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.538946 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.539252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.539558 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.539877 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.540184 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.540489 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.540833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.541143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.541372 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:31:59.541811 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.541905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:31:59.541997 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.542087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.542188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:31:59.542330 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.542513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:31:59.542647 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.542809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:31:59.542954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.543147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.543286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.543484 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.543590 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.543802 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.543897 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.550106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.550223 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.550223 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.550394 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.550480 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.550576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.550667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.551607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.551740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.551829 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.551930 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552021 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552194 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846054-1-iscsi {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552626 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552821 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.552905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.553069 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.553164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.553264 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.553359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.553458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.553549 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.553641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.553732 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.553822 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.553905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.554181 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.554181 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.554371 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.554478 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.554570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.554653 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.554906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.554906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.555091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.555091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.555250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.555338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.555435 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.555518 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.555611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.555699 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.555699 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.555856 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.555946 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.556029 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.556119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.556210 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.556300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.556389 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.556481 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.556579 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846054-1-iscsi {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.556686 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.556772 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.556919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.557023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.557161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.557252 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.557323 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.557323 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.557495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.557495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.557687 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.557765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.557835 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.557904 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.557981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.558058 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.558142 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.558232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.558317 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.558398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.558494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.558578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.558732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.558862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.558953 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.559025 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.559103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.559180 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.559250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.559327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.559398 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.559476 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.559568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.559646 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.559735 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.559825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.559914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.560010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.560103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.560194 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.560286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.560379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.560469 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.560561 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.560688 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.560787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.560879 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.560969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.561061 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.561152 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.561152 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.561312 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.561467 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.561591 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.561822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.561914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.562106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.562205 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.562412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.562501 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.562712 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.562842 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.563017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.563097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.563325 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.563428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.563634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.563727 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.563936 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.564044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.564245 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.564394 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.564567 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.564705 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.564927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.565047 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.565385 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.565494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.565583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.565678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.565903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.566015 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.566217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.566317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.566500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.566641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.566811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.566910 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.567154 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.567257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.567477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.567611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.568140 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.568284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.568464 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.568590 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.568815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.568930 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.569121 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.569209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.569427 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.569524 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.569735 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.569830 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.570041 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.570138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.570357 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.570449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.570669 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.570773 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.570922 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.571019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.571228 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.571318 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.571535 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.571631 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.571856 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.572003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.572165 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.572323 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.572473 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.572636 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.572805 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.572991 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.573095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.573321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.573413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.573625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.573715 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.573955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.574161 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.574268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.574364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.574569 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.574680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.574870 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.574972 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.575171 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.575267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.575470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.575559 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.575773 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.575874 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.576073 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.576168 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.576384 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.576474 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.576708 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.576815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.577014 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.577112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.577318 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.577418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.577617 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.577707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.577919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.578022 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.578234 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.578321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.578557 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.578657 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.578842 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.578938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.579148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.579244 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.579449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.579537 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.579773 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.579876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.580081 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.580170 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.580391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.580480 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.580739 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.580851 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.581046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.581142 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.581355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.581453 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.581675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.581772 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.582030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.582175 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.582341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.582499 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.582809 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.582900 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.583122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.583211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.583431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.583531 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.583741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.583839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.584048 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.584145 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.584355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.584446 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.584680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.584810 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.585001 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.585110 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.585314 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.585418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.585626 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.585721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.585929 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.586025 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.586233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.586329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.586555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:31:59.586644 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.586894 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.586994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.587206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.587300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.587528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.587618 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.587837 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.587932 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.588155 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.588264 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.588464 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.588576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.588799 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.588914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.589105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.589196 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.589411 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.589510 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.589731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.589839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.590059 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.590169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.590375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.590471 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.590685 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.590782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.591030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.591133 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.591331 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.591429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.591646 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.591751 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.591952 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.592047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.592267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.592370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.592582 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.592804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.592929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.593017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.593238 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.593326 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.593551 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.593660 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.593869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.593972 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.594181 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.594286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.594488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.594670 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.594805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.595022 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.595119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.595341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.595449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.595676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.595799 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.595993 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.596089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.596302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.596406 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.596613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.596771 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.596944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.597061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.597262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.597391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.598007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.598160 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.598333 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.598527 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.598527 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.598710 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.598843 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.598938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.599127 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.599252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.599435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.599536 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.599745 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.599834 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.600068 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.600166 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.600372 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.600462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.600712 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.600807 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.601029 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.601130 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.601343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.601442 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.601651 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.601749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.601963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.602079 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.602277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.602368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.602586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.602685 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.602895 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.603071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.603246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.603382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.603483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.603702 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.603801 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.604023 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.604126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.604333 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.604475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.604662 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.604755 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.604989 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.605081 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.605302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.605401 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.605638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.605781 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.605924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.606021 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.606237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.606336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.606549 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.606650 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.606861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.606954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.607169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.607257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.607481 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.607568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.607795 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.607886 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.608105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.608207 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.608415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.608520 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.608767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.608874 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.609052 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.609158 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.609363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.609465 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.609669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.609768 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.609989 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.610259 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.610356 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.610602 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.610699 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.610912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.611008 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.611229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.611328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.611550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.611638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.611862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.611952 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.612177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.612279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.612509 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.612597 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.612874 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.612964 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.613233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.613327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.613554 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.613676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.613862 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.614096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.614197 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.614424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.614564 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.614737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.614835 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.615052 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.615142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.615359 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.615459 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.615668 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.615766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.615968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.616069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.616277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.616367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.616581 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.616724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.616918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.617007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.617227 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.617330 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.617531 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.617629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.617834 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.617924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.618140 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.618263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.618465 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.618574 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.618770 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.618860 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.619075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.619184 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.619382 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.619479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.619685 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.619782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.620027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.620120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.620346 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.620441 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.620722 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.620832 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.621047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.621143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.621375 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.621481 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.621683 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.621996 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.622326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.622483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.622632 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.622814 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.622940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.623140 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.623237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.623462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.623558 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.623784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.623888 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.624102 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.624197 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.624410 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.624742 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.625054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.625364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.625470 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.625748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.625857 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.626059 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.626176 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.626405 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.626662 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.626766 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.626932 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.627061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.627246 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.627401 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.627553 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.627748 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.628003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.628090 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.628182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.628380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.628515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.628867 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.629087 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.629185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.629467 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.629646 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.629783 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.630067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.630227 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.630433 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.630704 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.630800 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.631017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.631113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.631326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.631431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.631641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.631736 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.631955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.632059 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.632262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.632357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.632584 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.632740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.632945 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.633037 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.633222 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.633314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.633531 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.633641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.633844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.633948 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.634148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.634251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.634454 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.634567 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.634766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.634862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.635092 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.635189 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.635471 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.635653 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.635731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.635809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.636169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.636271 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.636352 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.636441 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.636993 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.637164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.637164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.637450 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.637612 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.637761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.637908 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.638062 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.638229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.638386 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.638566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.638800 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.638964 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.639113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.639267 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.639418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.639659 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.639843 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.640065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.640228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.640386 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.640547 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.640746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.640909 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.641066 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.641222 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.641380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.641539 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.641697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.641846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.642000 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.642150 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.642297 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.642476 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.642629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.642778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.642932 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.643081 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.643244 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.643471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.643630 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.643790 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.643947 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.644103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.644267 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.644471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.644685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.644842 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.644991 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.645150 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.645299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.645456 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.645717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.645876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.646023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.646171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.646171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.646571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.646948 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.647117 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.647275 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.647431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.647589 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.647738 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.647894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.648049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.648198 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.648346 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.648507 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.648683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.649070 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.649245 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.649414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.649571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.649822 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.649979 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.650217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.650371 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.650519 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.650681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.650831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.650978 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.651134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.651291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.651450 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.651613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.651769 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.651927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.652085 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.652241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.652397 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.652560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.652759 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.652913 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.653071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.653220 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.653368 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.653368 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.653676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.653824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.653971 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.654128 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.654292 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.654441 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.654607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.654758 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.654915 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.655076 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.655233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.655382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.655540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.655704 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.655947 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.656104 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.656266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.656434 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.656701 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.657086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.657253 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.657404 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.657560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.657709 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.657857 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.658026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.658184 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.658349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.658498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.658653 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.658810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.658973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.659218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.659384 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.659534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.659681 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.659845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.660474 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.660637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.660899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.661057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.661214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.661381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.661539 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.661760 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.662006 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.662253 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.662497 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.662725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.662968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.663142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.663293 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.663450 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.663609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.663871 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.664126 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.664340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.664503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.664691 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.664856 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.665023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.665173 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.665368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.665570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.665723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.665886 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.666261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.666511 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.666877 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.667553 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.667728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.667892 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.668045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.668222 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.668460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.668628 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.668853 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.669016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.669165 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.669421 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.669585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.669736 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.669892 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.670069 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.670313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.670485 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.670759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.670924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.671096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.671256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.671404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.671551 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.671697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.671853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.672013 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.672162 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.672318 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.672474 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.672621 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.672791 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.672966 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.673137 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.673294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.673450 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.673606 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.673755 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.673911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.674068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.674224 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.675996 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.676170 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.676335 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.676335 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.676785 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.677060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.677060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.677540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.677871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.677871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.678323 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.678482 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.678482 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.678827 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.678994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.678994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.679294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.679552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.679552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.679842 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.680000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.680166 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.680514 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.680514 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.680956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.681124 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.681124 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.681418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.681568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.681568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.681869 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.682027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.682027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.682365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.682524 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.682673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.682821 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.682821 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.683120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.683276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.683435 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.683583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.683583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.683893 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.684050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.684050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.684335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.684483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.684483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.684824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.684975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.685133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.685281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.685281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.685571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.685720 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.685720 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.686011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.686158 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.686158 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.686463 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.686621 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.686621 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.687050 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.687285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.687285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.687745 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.688016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.688016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.688328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.688477 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.688477 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.688831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.688982 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.688982 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.689283 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.689440 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.689440 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.690090 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.690248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.690248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.691211 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.691528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.691528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.691892 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.692045 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.692045 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.692480 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.692632 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.693143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.693295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.693452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.693604 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.693751 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.693923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.693923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.694217 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.694395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.694395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.694689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.694855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.694855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.695151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.695301 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.695301 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.695879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.696061 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.696225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.696374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.696374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.696698 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.696856 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.697037 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.697325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.697573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.697573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.698182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.698341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.698489 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.698648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.698797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.699142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.699303 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.699454 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.699618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.699776 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.700039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.700209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.700368 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.700518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.700686 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.700842 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.701013 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.701370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.701529 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.701686 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.701837 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.701985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.702133 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.702297 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.702455 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.702611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.702761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.702909 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.703069 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.703299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.703452 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.703604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.703766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.703922 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.704081 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.704232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.704391 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.704539 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.704746 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.704909 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.705358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.705524 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.705675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.705831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.705981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.705981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.706276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.706425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.706582 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.706739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.707177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.707374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.707730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.708074 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.708342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.708683 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.708863 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.708863 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.709170 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.709320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.709468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.709617 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.709774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.709938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.710192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.710365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.710514 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.710663 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.710821 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.710971 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.711127 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.711294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.711294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.711775 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.711939 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.712089 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.712236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.712390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.712563 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.712788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.712956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.713107 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.713262 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.713418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.713575 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.713731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.713890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.714048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.714205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.714365 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.714515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.714683 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.714841 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.715003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.715164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.715320 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.715477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.715639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.715639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.715931 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.716086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.716236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.716236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.716527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.716704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.716870 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.717021 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.717021 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.717302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.717460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.717609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.717937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.718245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.718509 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.718681 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.718839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.719000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.719149 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.719298 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.719461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.719621 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.719771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.719928 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.719928 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.720323 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.720479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.720637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.720962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.721123 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.721285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.721464 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.721792 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.721991 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.722153 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.722312 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.722645 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.722772 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.722894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.723051 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.723169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.723368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.723518 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.723676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.723833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.723982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.723982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.724311 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.724311 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.724602 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.724852 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.725017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.725169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.725319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.725467 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.725613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.725787 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.725937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.726085 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.726267 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.726421 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.726578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.726727 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.726919 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.727075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.727224 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.727371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.727530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.727651 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.727761 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.727901 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.728496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.728773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.728922 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.729059 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.729223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.729354 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.729354 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.729609 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.729740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.729865 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.729998 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.730133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.730133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.730589 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.730750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.730911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.731061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.731210 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.731368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.731534 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.731714 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.732050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.732214 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.732427 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.732591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.732805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.732805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.733109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.733109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.733400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.733562 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.733714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.733868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.733868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.734152 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.734320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.734510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.734673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.734825 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.734988 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.735149 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.735891 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.736141 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.736141 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.736476 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.736476 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.736817 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.737043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.737248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.737402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.737402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.737691 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.737840 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.738003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.738352 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.738691 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.738958 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.738958 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.739269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.739433 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.739433 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.739740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.739889 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.740048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.740206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.740370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.740764 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.740933 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.741084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.741240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.741389 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.741546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.741730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.741895 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.742228 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.742385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.742542 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.742656 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.742910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.743063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.743220 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.743376 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.743534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.743684 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.743839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.744021 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.744189 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.744346 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.744505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.744505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.744827 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.744996 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.745147 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.745305 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.745461 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.745618 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.745774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.745923 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.746110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.746284 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.746435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.746591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.746788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.746945 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.747102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.747261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.747412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.747568 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.747717 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.747865 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.748013 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.748212 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.748212 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.749143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.749314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.749468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.749629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.749779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.749935 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.750093 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.750276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.750430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.750612 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.750892 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.751050 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.751200 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.751355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.751504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.751661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.751661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.751953 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.752101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.752443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.752609 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.752796 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.752796 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.753101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.753101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.753393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.753555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.753714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.753919 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.754070 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.754218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.754590 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.754785 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.754978 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.755141 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.755289 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.755461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.755620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.755783 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.755942 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.756131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.756282 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.756502 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.756719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.756719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.757024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.757226 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.757377 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.757571 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.757735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.757894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.758049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.758199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.758374 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.758783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.759154 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.759424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.759581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.759737 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.759926 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.760094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.760294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.760459 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.760609 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.760804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.761070 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.761239 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.761390 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.761539 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.761539 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.761867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.762038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.762199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.762599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.762768 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.762927 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.763077 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.763077 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.763411 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.763566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.763715 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.763862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.764059 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.764227 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.764377 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.764607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.764841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.764999 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.765149 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.765310 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.765468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.765647 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.765809 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.765966 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.766156 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.766318 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.766467 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.766615 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.766782 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.766930 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.767091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.767242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.767398 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.767554 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.767742 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.767742 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.768041 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.768221 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.768383 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.768383 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.768803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.769236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.769544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.769842 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.770035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.770187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.770337 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.770497 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.770656 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.770806 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.770955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.771196 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.771196 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.771517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.771517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.771854 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.772017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.772175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.772175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.772503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.772859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.773018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.773167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.773326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.773486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.773649 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.773649 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.773649 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.774104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.774254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.774411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.774569 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.774720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.774875 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.775027 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.775183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.775343 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.775492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.775659 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.775808 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.775956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.776105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.776303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.776303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.776604 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.776788 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.776947 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.777105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.777256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.777403 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.777562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.777711 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.777859 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.778046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.778212 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.778369 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.778519 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.778667 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.778913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.779101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.779476 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.779635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.779802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780050 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780221 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:31:59.780407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.780407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.781690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.781690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.781690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.781690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.781690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.781690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.781690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.781690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.783104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.783104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.783104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.783104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.783104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.783104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.783104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.783104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.784263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.784263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.784263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.784263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.784263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.784263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.784263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.784263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.785560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.785560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.785560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.785560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.785560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.785560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.785560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.785560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.786735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.786735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.786735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.786735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.786735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.786735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.786735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.786735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.787861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.787861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.787861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.787861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.787861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.787861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.787861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.787861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.789120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.789120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.789120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.789120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.789120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.789120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.789120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.789120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.790697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.790697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.790697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.790697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.790697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.790697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.790697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.790697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.791929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.791929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.791929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.791929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.791929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.791929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.792903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.792903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.792903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.793503 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.793503 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.793786 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.793993 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.794297 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.794607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.794914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.795218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.795522 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.795915 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.796106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.796407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.796745 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.797053 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.797355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.797661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.797964 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.798270 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.798574 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.798878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.799182 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.799486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.799875 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.800114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.800449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.800843 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.801172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.801557 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.801810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.802122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.802447 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.802771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.803108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.803626 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.803785 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.804012 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.804327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.804641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.804977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.805288 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.805601 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.805933 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.806262 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.806572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.806901 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.807220 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.807542 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.807861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.808172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.808504 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.808847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.809164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.809475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.809836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.810099 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.810434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.810715 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.811025 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.811342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.811669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.811980 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.812308 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.812619 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.812970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.813296 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.813647 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.813954 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.814306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.814626 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.814943 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.815256 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.815562 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:31:59.815807 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:31:59.832588 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO dbcounter [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Registered counter for database nova_api Aug 24 12:31:59.854393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_db.sqlalchemy.engines [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:59.861365 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writer thread running {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:59.879097 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO dbcounter [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Registered counter for database nova_api Aug 24 12:31:59.899754 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_db.sqlalchemy.engines [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:59.906777 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writer thread running {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:59.918506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.context [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1(cell1) {{(pid=127299) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:31:59.923373 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:59.923825 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:59.925449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:59.926234 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:59.926673 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:59.928666 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:59.930678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO dbcounter [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Registered counter for database nova_cell0 Aug 24 12:31:59.934895 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO dbcounter [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Registered counter for database nova_cell1 Aug 24 12:31:59.942257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_db.sqlalchemy.engines [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:59.944557 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_db.sqlalchemy.engines [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:59.951058 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writer thread running {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:59.953724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writer thread running {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:31:59.973032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.context [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1(cell1) {{(pid=127298) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 12:31:59.977255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:59.977717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:59.979337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:59.980085 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:31:59.980531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:31:59.982623 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:31:59.984689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO dbcounter [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Registered counter for database nova_cell0 Aug 24 12:31:59.989210 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO dbcounter [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Registered counter for database nova_cell1 Aug 24 12:31:59.996552 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_db.sqlalchemy.engines [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:31:59.998799 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_db.sqlalchemy.engines [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:32:00.003428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writer thread running {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:32:00.009251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writer thread running {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:32:00.098132 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO dbcounter [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Registered counter for database nova_cell0 Aug 24 12:32:00.105719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_db.sqlalchemy.engines [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:32:00.111179 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writer thread running {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:32:00.151340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO dbcounter [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Registered counter for database nova_cell0 Aug 24 12:32:00.158596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_db.sqlalchemy.engines [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:32:00.167964 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writer thread running {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:32:00.453206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: WARNING keystonemiddleware.auth_token [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:32:00.460826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: WARNING keystonemiddleware.auth_token [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:32:00.486769 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: WARNING keystonemiddleware.auth_token [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:32:00.494446 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: WARNING keystonemiddleware.auth_token [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:32:00.810787 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: WARNING keystonemiddleware.auth_token [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:32:00.818021 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: WARNING keystonemiddleware.auth_token [None req-ac6d765e-e8fb-428c-b24c-76c92a6ed7d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:32:00.823528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bdac8829c0 pid: 127299 (default app) Aug 24 12:32:00.844988 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: WARNING keystonemiddleware.auth_token [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 12:32:00.851281 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: WARNING keystonemiddleware.auth_token [None req-8dfbffce-ea36-4d03-a33c-894235512579 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 12:32:00.856588 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bdac8829c0 pid: 127298 (default app) Aug 24 12:32:36.205279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=3 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:36.206260 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=3 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:36.207323 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=3 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:36.208283 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=3 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:37.980139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8f27e685-49f3-40e4-ab78-8b9cad31d016 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Action: 'create', calling method: .version_select at 0x7fa67cd5d5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-877836899"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:39.384833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8f27e685-49f3-40e4-ab78-8b9cad31d016 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.202765 Aug 24 12:32:39.385827 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1155 bytes} [Wed Aug 24 12:32:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3207 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 12:32:39.677803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2db83165-95c6-4fd0-9f62-99b87633f885 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cc314c0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:39.784588 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2db83165-95c6-4fd0-9f62-99b87633f885 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/92133d9f-23a2-4fbe-b366-bbc56f93630f" status: 200 len: 350 microversion: 2.1 time: 0.111399 Aug 24 12:32:39.786160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 2/2] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:39 2022] GET /compute/v2.1/os-volumes/92133d9f-23a2-4fbe-b366-bbc56f93630f => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:32:39.978039 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-71e28d8a-59ad-4512-a773-278806963c0e tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67ce8b1f0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:40.054387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:40.055926 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:40.057704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:40.059016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:32:40.647645 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-71e28d8a-59ad-4512-a773-278806963c0e tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2" status: 200 len: 345 microversion: 2.1 time: 1.250798 Aug 24 12:32:40.648243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:39 2022] GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 => generated 345 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:40.663723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a0215f2b-cb38-48b5-befc-557cfbed3daa tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Action: 'create', calling method: .version_select at 0x7fa67cc31b80>, body: {"snapshot": {"volume_id": "465630cd-55bf-424b-8aba-1766a8b185a2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-185014570"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:41.176975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a0215f2b-cb38-48b5-befc-557cfbed3daa tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.516859 Aug 24 12:32:41.177833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 3/4] 10.222.0.27 () {60 vars in 1162 bytes} [Wed Aug 24 12:32:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:32:41.193537 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cc6690c0-9895-435e-97db-861065d6924c tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc844c0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:41.330563 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cc6690c0-9895-435e-97db-861065d6924c tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331" status: 200 len: 286 microversion: 2.1 time: 0.144625 Aug 24 12:32:41.337321 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 2/5] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 12:32:41 2022] GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:41.342420 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a1ac65e8-ea8d-4601-baaa-3ade8355b3e6 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc47c10>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:41.440371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a1ac65e8-ea8d-4601-baaa-3ade8355b3e6 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.101613 Aug 24 12:32:41.441096 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 4/6] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Aug 24 12:32:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:41.454774 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-268d869b-9894-492e-9526-624e070b7dfa tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc84430>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:41.552045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-268d869b-9894-492e-9526-624e070b7dfa tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331" status: 200 len: 286 microversion: 2.1 time: 0.102428 Aug 24 12:32:41.557695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 12:32:41 2022] GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:41.606998 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ae541242-2c54-4955-b601-0be6820e66df tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cc31f70>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:41.721457 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ae541242-2c54-4955-b601-0be6820e66df tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bab6cb5b-08f0-44f7-b408-72b97ce226b7" status: 200 len: 351 microversion: 2.1 time: 0.118117 Aug 24 12:32:41.722065 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:41 2022] GET /compute/v2.1/os-volumes/bab6cb5b-08f0-44f7-b408-72b97ce226b7 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:32:42.569789 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-53225590-11e7-440e-bbec-7179af4d79a1 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc84d30>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:42.643294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-53225590-11e7-440e-bbec-7179af4d79a1 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331" status: 200 len: 286 microversion: 2.1 time: 0.081394 Aug 24 12:32:42.644737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 4/9] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 12:32:42 2022] GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:43.657585 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fd104979-9e5c-4841-ae60-8b73930507e6 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc315e0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:43.861174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fd104979-9e5c-4841-ae60-8b73930507e6 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331" status: 200 len: 286 microversion: 2.1 time: 0.207131 Aug 24 12:32:43.866677 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 6/10] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 12:32:43 2022] GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 => generated 286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:44.875013 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1c46a395-da8e-4206-844f-86158767ddb7 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc2c430>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:44.930502 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1c46a395-da8e-4206-844f-86158767ddb7 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331" status: 200 len: 287 microversion: 2.1 time: 0.061709 Aug 24 12:32:44.938519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 5/11] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 12:32:44 2022] GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:44.967743 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8ec21f80-fa4f-4bb7-9eab-d5f9dade874e tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc491f0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:45.092610 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8ec21f80-fa4f-4bb7-9eab-d5f9dade874e tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331" status: 202 len: 0 microversion: 2.1 time: 0.126093 Aug 24 12:32:45.103853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 7/12] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Aug 24 12:32:44 2022] DELETE /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:32:45.105560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b5f917b9-c2c3-4981-9f9b-ea801d2502ca tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc84ca0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:45.168204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b5f917b9-c2c3-4981-9f9b-ea801d2502ca tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331" status: 200 len: 286 microversion: 2.1 time: 0.067610 Aug 24 12:32:45.169283 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 6/13] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 12:32:45 2022] GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:46.054508 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e1ea106d-d46d-4884-9fa6-83419c278682 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cc31820>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.123793 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e1ea106d-d46d-4884-9fa6-83419c278682 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a57b6379-2fec-4317-8d40-6252af8fb53b" status: 200 len: 351 microversion: 2.1 time: 0.073601 Aug 24 12:32:46.124776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 8/14] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/os-volumes/a57b6379-2fec-4317-8d40-6252af8fb53b => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:46.138230 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ad9f02c3-09c6-450c-aa1b-cbfd9f6d863c tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cc84430>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.182542 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-59cd0aa0-c2e5-44ef-9a6c-ef6894623d4c tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67d6098b0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.237086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-59cd0aa0-c2e5-44ef-9a6c-ef6894623d4c tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] HTTP exception thrown: Snapshot bfa4e800-7b2e-4c54-b166-1d21fb54f331 could not be found. Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-59cd0aa0-c2e5-44ef-9a6c-ef6894623d4c tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Request method failure captured: Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 HTTP/1.1 Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhpkE28pXzeCDlvj3IOWLDK4qMTc9UH2e5NPCM7Pii93nXq7N5AJ7JGPMQLi7nceiSWVbUVMkqlK3LYQYvqQstsR109A2dxKBAatD2Wi0Tf2PEcmFP0XyTEN1hQvrCTjgIbzttPlPADBHtEj5q_2fYNZuxPfxhREO0HYormr0xBlnuE Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 27c1d9bc37534d32b9bc0212a80e672b Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:32:46.241884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27c1d9bc37534d32b9bc0212a80e672b"}]}] Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 27c1d9bc37534d32b9bc0212a80e672b Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-VolumesSnapshotsTestJSON-1030807081-project Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 63abae805aae45509764b9747f248ad2 Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030807081-project Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Snapshot bfa4e800-7b2e-4c54-b166-1d21fb54f331 could not be found. Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': 'bfa4e800-7b2e-4c54-b166-1d21fb54f331'} Aug 24 12:32:46.243194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bfa4e800-7b2e-4c54-b166-1d21fb54f331 could not be found. (HTTP 404) (Request-ID: req-7d1dc0e7-07da-4a04-a6ec-958a5b31efef) Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:46.243924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:46.244876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bfa4e800-7b2e-4c54-b166-1d21fb54f331 could not be found. Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 12:32:46.245968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bfa4e800-7b2e-4c54-b166-1d21fb54f331 could not be found. Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bfa4e800-7b2e-4c54-b166-1d21fb54f331 could not be found. Aug 24 12:32:46.247466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:46.249826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-59cd0aa0-c2e5-44ef-9a6c-ef6894623d4c tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Returning 404 to user: Snapshot bfa4e800-7b2e-4c54-b166-1d21fb54f331 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:46.250841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-59cd0aa0-c2e5-44ef-9a6c-ef6894623d4c tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331" status: 404 len: 111 microversion: 2.1 time: 0.073341 Aug 24 12:32:46.251601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 9/15] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/os-snapshots/bfa4e800-7b2e-4c54-b166-1d21fb54f331 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:32:46.263270 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0e5a346c-3362-4c13-801d-baf387c954cf tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc49940>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.289695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ad9f02c3-09c6-450c-aa1b-cbfd9f6d863c tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.155487 Aug 24 12:32:46.290176 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 7/16] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:46.306102 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1e8dc992-b2d2-4013-9b23-54a6c12dac56 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cc84a60>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.376721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0e5a346c-3362-4c13-801d-baf387c954cf tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2" status: 202 len: 0 microversion: 2.1 time: 0.118160 Aug 24 12:32:46.377281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 10/17] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:32:46 2022] DELETE /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:32:46.385985 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7d8b6a1a-2861-4794-bc21-dcf5f8d0ba1f tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc49ee0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.445820 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1e8dc992-b2d2-4013-9b23-54a6c12dac56 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.143754 Aug 24 12:32:46.446899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 8/18] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:32:46.463604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-48011df3-004d-48ed-888a-48a9d92e59de tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cc3f4c0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.518116 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7d8b6a1a-2861-4794-bc21-dcf5f8d0ba1f tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2" status: 200 len: 344 microversion: 2.1 time: 0.135952 Aug 24 12:32:46.518970 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 11/19] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:32:46.679043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-48011df3-004d-48ed-888a-48a9d92e59de tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.219229 Aug 24 12:32:46.679809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 9/20] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:46.695784 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-416bc771-ba4f-4029-9dae-b893fb690db8 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cbb5550>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:46.864906 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-416bc771-ba4f-4029-9dae-b893fb690db8 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.175053 Aug 24 12:32:46.866240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 12/21] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:46.879596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b15c92ba-f4eb-4d22-90f4-78969a694fc0 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cc3f8b0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:47.052078 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b15c92ba-f4eb-4d22-90f4-78969a694fc0 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.176338 Aug 24 12:32:47.053068 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 10/22] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Aug 24 12:32:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:47.067055 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-71818c54-498a-4219-b91b-e6ab449c1cae tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cbb5430>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:47.257011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-71818c54-498a-4219-b91b-e6ab449c1cae tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.194464 Aug 24 12:32:47.258159 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 13/23] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Aug 24 12:32:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:47.271724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a1f9cd11-0487-4c82-85db-4d47bae2a7c8 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67d6089d0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:47.451916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a1f9cd11-0487-4c82-85db-4d47bae2a7c8 tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.184678 Aug 24 12:32:47.452590 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1188 bytes} [Wed Aug 24 12:32:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:47.465985 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-091a199c-90e7-4ff7-85a9-053a82a7df4e tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] Calling method '.version_select at 0x7fa67cbb68b0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:47.533241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3c958e71-5333-413b-b3d3-cf3e3db6be25 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc404c0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:47.617205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-3c958e71-5333-413b-b3d3-cf3e3db6be25 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] HTTP exception thrown: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3c958e71-5333-413b-b3d3-cf3e3db6be25 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Request method failure captured: Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 HTTP/1.1 Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhpkE28pXzeCDlvj3IOWLDK4qMTc9UH2e5NPCM7Pii93nXq7N5AJ7JGPMQLi7nceiSWVbUVMkqlK3LYQYvqQstsR109A2dxKBAatD2Wi0Tf2PEcmFP0XyTEN1hQvrCTjgIbzttPlPADBHtEj5q_2fYNZuxPfxhREO0HYormr0xBlnuE Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 27c1d9bc37534d32b9bc0212a80e672b Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:32:47.621643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27c1d9bc37534d32b9bc0212a80e672b"}]}] Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 27c1d9bc37534d32b9bc0212a80e672b Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesSnapshotsTestJSON-1030807081-project Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 63abae805aae45509764b9747f248ad2 Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030807081-project Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '465630cd-55bf-424b-8aba-1766a8b185a2'} Aug 24 12:32:47.622811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. (HTTP 404) (Request-ID: req-b6807f67-6c59-4725-853a-adb29f26c908) Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.623479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:47.624458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:32:47.625638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.628320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3c958e71-5333-413b-b3d3-cf3e3db6be25 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Returning 404 to user: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:47.629978 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3c958e71-5333-413b-b3d3-cf3e3db6be25 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2" status: 404 len: 109 microversion: 2.1 time: 0.099738 Aug 24 12:32:47.631295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 12/25] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:47 2022] GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:32:47.650602 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6a48f2d9-54a6-486f-b70a-c59c354046d1 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cc3f1f0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:47.696136 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-091a199c-90e7-4ff7-85a9-053a82a7df4e tempest-VolumesTestJSON-1645040167 tempest-VolumesTestJSON-1645040167-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.233895 Aug 24 12:32:47.697589 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 14/26] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Aug 24 12:32:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:47.742084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-6a48f2d9-54a6-486f-b70a-c59c354046d1 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] HTTP exception thrown: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6a48f2d9-54a6-486f-b70a-c59c354046d1 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Request method failure captured: Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 HTTP/1.1 Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhpkE28pXzeCDlvj3IOWLDK4qMTc9UH2e5NPCM7Pii93nXq7N5AJ7JGPMQLi7nceiSWVbUVMkqlK3LYQYvqQstsR109A2dxKBAatD2Wi0Tf2PEcmFP0XyTEN1hQvrCTjgIbzttPlPADBHtEj5q_2fYNZuxPfxhREO0HYormr0xBlnuE Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 27c1d9bc37534d32b9bc0212a80e672b Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:32:47.744329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27c1d9bc37534d32b9bc0212a80e672b"}]}] Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 27c1d9bc37534d32b9bc0212a80e672b Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesSnapshotsTestJSON-1030807081-project Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 63abae805aae45509764b9747f248ad2 Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030807081-project Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '465630cd-55bf-424b-8aba-1766a8b185a2'} Aug 24 12:32:47.745525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. (HTTP 404) (Request-ID: req-8ddbc50e-8057-4eff-83b4-41ba0951fbfe) Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.746213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:32:47.750157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 12:32:47.751095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6a48f2d9-54a6-486f-b70a-c59c354046d1 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Returning 404 to user: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6a48f2d9-54a6-486f-b70a-c59c354046d1 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2" status: 404 len: 109 microversion: 2.1 time: 0.108258 Aug 24 12:32:47.752093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:32:47 2022] DELETE /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:32:47.754907 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-09f7cb65-77cf-4f4d-947a-ede20e866459 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Calling method '.version_select at 0x7fa67cbbeb80>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:47.819536 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-09f7cb65-77cf-4f4d-947a-ede20e866459 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] HTTP exception thrown: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-09f7cb65-77cf-4f4d-947a-ede20e866459 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Request method failure captured: Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 HTTP/1.1 Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhpkE28pXzeCDlvj3IOWLDK4qMTc9UH2e5NPCM7Pii93nXq7N5AJ7JGPMQLi7nceiSWVbUVMkqlK3LYQYvqQstsR109A2dxKBAatD2Wi0Tf2PEcmFP0XyTEN1hQvrCTjgIbzttPlPADBHtEj5q_2fYNZuxPfxhREO0HYormr0xBlnuE Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 27c1d9bc37534d32b9bc0212a80e672b Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:32:47.822231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27c1d9bc37534d32b9bc0212a80e672b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27c1d9bc37534d32b9bc0212a80e672b"}]}] Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 27c1d9bc37534d32b9bc0212a80e672b Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030807081 Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-VolumesSnapshotsTestJSON-1030807081-project Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 63abae805aae45509764b9747f248ad2 Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030807081-project Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '465630cd-55bf-424b-8aba-1766a8b185a2'} Aug 24 12:32:47.823374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. (HTTP 404) (Request-ID: req-5a9a2584-db2e-4a84-aac8-f1a00c320ccf) Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:47.828363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:32:47.829694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-09f7cb65-77cf-4f4d-947a-ede20e866459 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] Returning 404 to user: Volume 465630cd-55bf-424b-8aba-1766a8b185a2 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-09f7cb65-77cf-4f4d-947a-ede20e866459 tempest-VolumesSnapshotsTestJSON-1030807081 tempest-VolumesSnapshotsTestJSON-1030807081-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2" status: 404 len: 109 microversion: 2.1 time: 0.073318 Aug 24 12:32:47.831273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 15/28] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:47 2022] GET /compute/v2.1/os-volumes/465630cd-55bf-424b-8aba-1766a8b185a2 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:32:48.707363 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-297725fa-966f-4e3b-9cdc-091b025d6bbc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'create', calling method: .version_select at 0x7fa67cc3f0d0>, body: {"keypair": {"name": "tempest-keypair-2030226403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJW2sKj+x3LwVB9/xypa+ZwfaQkJDkKtvU2mDYwVwYMXjE6WW/ppNfmZrPCgfOS+GVaFd3CiXFNOXImy2zNhLlvbRT7+jYfpWf1v96sRp1+il6HcI+dSVSfkBE8TXLrZg=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:48.804744 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-297725fa-966f-4e3b-9cdc-091b025d6bbc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Getting quotas for project 96fea11cfdd748bab1cdea46b073dc89. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:48.821681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-297725fa-966f-4e3b-9cdc-091b025d6bbc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Getting quotas for user 85d8138d44bc40dd8f63ee4916ffbce9 and project 96fea11cfdd748bab1cdea46b073dc89. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:48.936408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-297725fa-966f-4e3b-9cdc-091b025d6bbc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.896132 Aug 24 12:32:48.937711 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 14/29] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:32:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:52.536271 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1187879724", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "networks": [{"uuid": "6857f82f-b98c-4365-bd2c-869b997707ea"}]}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:52.800619 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] validate_networks() for [('6857f82f-b98c-4365-bd2c-869b997707ea', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:53.500082 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-92c57924-edeb-44e8-af99-284112f5b29d tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Action: 'create', calling method: .version_select at 0x7fa67cb93040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1438829064", "metadata": {"Type": "work"}}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-92c57924-edeb-44e8-af99-284112f5b29d tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Request method failure captured: Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 122 Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp032Sb4sFI9ZiBBZGTID1lTxSvjxt9KeAxw-PT9sNUZqPN373DnkqiyAso1Zn8ZlvmkXYoynU3tY23Vz17MT93zYTKFnDFG6vkA2_cjfpoDhQToGduFP_tgeq_oyCro3FgUs2_tHCTEl5t6I2jH8k9rrQKPg0rVX-i-j4xh9QGyHo Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:32:53.507429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035366777d4148938b22d4f33eccae60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035366777d4148938b22d4f33eccae60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}] Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 3afd2d65e39e4392a8c0c82400f28057 Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1438829064", "metadata": {"Type": "work"}}} Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:32:53.508867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1438829064', 'metadata': {'Type': 'work'}}}} Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:53.509526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:32:53.510545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:32:53.511537 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 12:32:53.511537 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.511537 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-92c57924-edeb-44e8-af99-284112f5b29d tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:53.511537 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-92c57924-edeb-44e8-af99-284112f5b29d tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.407772 Aug 24 12:32:53.519725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 15/30] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 24 12:32:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 419 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:32:53.536637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-008fefa6-4598-4e84-ba5c-39dfe4bc569f tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Action: 'create', calling method: .version_select at 0x7fa67c33eee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1615219234", "metadata": {"Type": "work"}}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-008fefa6-4598-4e84-ba5c-39dfe4bc569f tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Request method failure captured: Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 120 Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp032Sb4sFI9ZiBBZGTID1lTxSvjxt9KeAxw-PT9sNUZqPN373DnkqiyAso1Zn8ZlvmkXYoynU3tY23Vz17MT93zYTKFnDFG6vkA2_cjfpoDhQToGduFP_tgeq_oyCro3FgUs2_tHCTEl5t6I2jH8k9rrQKPg0rVX-i-j4xh9QGyHo Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:32:53.541273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035366777d4148938b22d4f33eccae60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035366777d4148938b22d4f33eccae60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}] Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 3afd2d65e39e4392a8c0c82400f28057 Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1615219234", "metadata": {"Type": "work"}}} Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:32:53.542380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1615219234', 'metadata': {'Type': 'work'}}}} Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi '0' Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:53.543135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:32:53.544133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:32:53.545100 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 12:32:53.545100 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.545759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-008fefa6-4598-4e84-ba5c-39dfe4bc569f tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:53.546764 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-008fefa6-4598-4e84-ba5c-39dfe4bc569f tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025938 Aug 24 12:32:53.547789 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 16/31] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 24 12:32:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:32:53.558852 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9aea526e-3e38-4ab5-b9d5-b7f5a4dcb1b9 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Action: 'create', calling method: .version_select at 0x7fa67cc3f5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1967602698", "metadata": {"Type": "work"}}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9aea526e-3e38-4ab5-b9d5-b7f5a4dcb1b9 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Request method failure captured: Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 119 Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp032Sb4sFI9ZiBBZGTID1lTxSvjxt9KeAxw-PT9sNUZqPN373DnkqiyAso1Zn8ZlvmkXYoynU3tY23Vz17MT93zYTKFnDFG6vkA2_cjfpoDhQToGduFP_tgeq_oyCro3FgUs2_tHCTEl5t6I2jH8k9rrQKPg0rVX-i-j4xh9QGyHo Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:32:53.568570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035366777d4148938b22d4f33eccae60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035366777d4148938b22d4f33eccae60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}] Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 3afd2d65e39e4392a8c0c82400f28057 Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1967602698", "metadata": {"Type": "work"}}} Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:32:53.569631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1967602698', 'metadata': {'Type': 'work'}}}} Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise error Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi '' Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:53.570255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 12:32:53.571275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 12:32:53.572191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 12:32:53.572191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.585134 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9aea526e-3e38-4ab5-b9d5-b7f5a4dcb1b9 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:53.586391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9aea526e-3e38-4ab5-b9d5-b7f5a4dcb1b9 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033030 Aug 24 12:32:53.587346 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 17/32] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 24 12:32:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:32:53.596609 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eebe75ad-ee8d-43f8-abe7-bc9efb06c45a tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Calling method '.version_select at 0x7fa67c2e1b80>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:53.695728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-eebe75ad-ee8d-43f8-abe7-bc9efb06c45a tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] HTTP exception thrown: Volume tempest-invalid-655358495 could not be found. Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eebe75ad-ee8d-43f8-abe7-bc9efb06c45a tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Request method failure captured: Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-655358495 HTTP/1.1 Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp032Sb4sFI9ZiBBZGTID1lTxSvjxt9KeAxw-PT9sNUZqPN373DnkqiyAso1Zn8ZlvmkXYoynU3tY23Vz17MT93zYTKFnDFG6vkA2_cjfpoDhQToGduFP_tgeq_oyCro3FgUs2_tHCTEl5t6I2jH8k9rrQKPg0rVX-i-j4xh9QGyHo Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:32:53.697839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035366777d4148938b22d4f33eccae60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035366777d4148938b22d4f33eccae60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}] Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 3afd2d65e39e4392a8c0c82400f28057 Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Volume tempest-invalid-655358495 could not be found. Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': 'tempest-invalid-655358495'} Aug 24 12:32:53.698918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-655358495 could not be found. (HTTP 404) (Request-ID: req-211647a2-94dc-4a9a-9cd6-bfe49e060549) Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.699538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:32:53.700422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-655358495 could not be found. Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:53.701331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-655358495 could not be found. Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-655358495 could not be found. Aug 24 12:32:53.702451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.706019 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eebe75ad-ee8d-43f8-abe7-bc9efb06c45a tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Returning 404 to user: Volume tempest-invalid-655358495 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:53.707254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-eebe75ad-ee8d-43f8-abe7-bc9efb06c45a tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-655358495" status: 404 len: 98 microversion: 2.1 time: 0.114902 Aug 24 12:32:53.708317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 18/33] 10.222.0.27 () {58 vars in 1215 bytes} [Wed Aug 24 12:32:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-655358495 => generated 98 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:32:53.720454 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-65a25f04-94de-4ffc-b738-5804d2714113 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005075 Aug 24 12:32:53.721411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 19/34] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Aug 24 12:32:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 12:32:53.734873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6dfe9a6d-3190-4c70-ad16-80447f96bb00 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006242 Aug 24 12:32:53.737959 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 20/35] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Aug 24 12:32:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 12:32:53.749283 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8dab493d-8ad3-4dfa-98a4-19de03fc0bb7 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Calling method '.version_select at 0x7fa67cc3fd30>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:53.836695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-8dab493d-8ad3-4dfa-98a4-19de03fc0bb7 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] HTTP exception thrown: Volume de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 could not be found. Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8dab493d-8ad3-4dfa-98a4-19de03fc0bb7 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Request method failure captured: Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/os-volumes/de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 HTTP/1.1 Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp032Sb4sFI9ZiBBZGTID1lTxSvjxt9KeAxw-PT9sNUZqPN373DnkqiyAso1Zn8ZlvmkXYoynU3tY23Vz17MT93zYTKFnDFG6vkA2_cjfpoDhQToGduFP_tgeq_oyCro3FgUs2_tHCTEl5t6I2jH8k9rrQKPg0rVX-i-j4xh9QGyHo Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:32:53.839306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035366777d4148938b22d4f33eccae60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035366777d4148938b22d4f33eccae60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}] Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 3afd2d65e39e4392a8c0c82400f28057 Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Volume de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 could not be found. Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': 'de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2'} Aug 24 12:32:53.840411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 could not be found. (HTTP 404) (Request-ID: req-01f14f11-c304-4f19-853f-f6bd9816a047) Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.841204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 12:32:53.842122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 could not be found. Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 12:32:53.843017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 could not be found. Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 could not be found. Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8dab493d-8ad3-4dfa-98a4-19de03fc0bb7 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Returning 404 to user: Volume de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8dab493d-8ad3-4dfa-98a4-19de03fc0bb7 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2" status: 404 len: 109 microversion: 2.1 time: 0.096676 Aug 24 12:32:53.843938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 21/36] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:32:53 2022] DELETE /compute/v2.1/os-volumes/de6cc6c6-4340-4ec3-9a1f-fc858b8adcf2 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:32:53.855016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2ff4a9ac-ba62-46b8-b275-cbf15726a995 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Calling method '.version_select at 0x7fa67cc3f820>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:53.895995 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-2ff4a9ac-ba62-46b8-b275-cbf15726a995 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] HTTP exception thrown: Volume 1876139b-15a1-48c4-93cd-16c2c91545e2 could not be found. Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2ff4a9ac-ba62-46b8-b275-cbf15726a995 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Request method failure captured: Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/os-volumes/1876139b-15a1-48c4-93cd-16c2c91545e2 HTTP/1.1 Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp032Sb4sFI9ZiBBZGTID1lTxSvjxt9KeAxw-PT9sNUZqPN373DnkqiyAso1Zn8ZlvmkXYoynU3tY23Vz17MT93zYTKFnDFG6vkA2_cjfpoDhQToGduFP_tgeq_oyCro3FgUs2_tHCTEl5t6I2jH8k9rrQKPg0rVX-i-j4xh9QGyHo Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:32:53.898578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035366777d4148938b22d4f33eccae60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035366777d4148938b22d4f33eccae60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035366777d4148938b22d4f33eccae60"}]}] Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 035366777d4148938b22d4f33eccae60 Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesNegativeTest-1046627303 Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 3afd2d65e39e4392a8c0c82400f28057 Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesNegativeTest-1046627303-project Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Volume 1876139b-15a1-48c4-93cd-16c2c91545e2 could not be found. Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '1876139b-15a1-48c4-93cd-16c2c91545e2'} Aug 24 12:32:53.899810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1876139b-15a1-48c4-93cd-16c2c91545e2 could not be found. (HTTP 404) (Request-ID: req-afd9e7f7-1146-4cac-821a-4b05dca2de6c) Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.900616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:32:53.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1876139b-15a1-48c4-93cd-16c2c91545e2 could not be found. Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:32:53.902740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1876139b-15a1-48c4-93cd-16c2c91545e2 could not be found. Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1876139b-15a1-48c4-93cd-16c2c91545e2 could not be found. Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:32:53.905690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2ff4a9ac-ba62-46b8-b275-cbf15726a995 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] Returning 404 to user: Volume 1876139b-15a1-48c4-93cd-16c2c91545e2 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:32:53.910835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2ff4a9ac-ba62-46b8-b275-cbf15726a995 tempest-VolumesNegativeTest-1046627303 tempest-VolumesNegativeTest-1046627303-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1876139b-15a1-48c4-93cd-16c2c91545e2" status: 404 len: 109 microversion: 2.1 time: 0.061709 Aug 24 12:32:53.912201 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 22/37] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:32:53 2022] GET /compute/v2.1/os-volumes/1876139b-15a1-48c4-93cd-16c2c91545e2 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:32:56.213147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1e64ca30-f3d8-4cec-87ad-68cc2bb79e1c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: .version_select at 0x7fa67cb93940>, body: {"keypair": {"name": "tempest-keypair-1702239500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy62Bod6MdlItPajoGWkSatlARGsr82NkkWyJbx/rNxyVUthZsNDD3lLH6PZMu6An9zXxXoeD94/EXbyzZ0gA4bcSPxEHAcbKE8rNpPJtYdOHifuDlUZO8CCkXbUvrP3Q=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:56.261473 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-1e64ca30-f3d8-4cec-87ad-68cc2bb79e1c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for project 75590a43f50b48699fc0d5a892a99544. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:56.289195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-1e64ca30-f3d8-4cec-87ad-68cc2bb79e1c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for user b4a617fc13534a89ad50a5fdc7bf769a and project 75590a43f50b48699fc0d5a892a99544. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:56.343781 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1e64ca30-f3d8-4cec-87ad-68cc2bb79e1c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.828504 Aug 24 12:32:56.351489 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 23/38] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:32:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:32:56.691748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:32:56.693050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:32:56.695136 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:32:56.695552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:32:56.695959 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:32:56.764453 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.768011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.770812 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.784016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:56.785348 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:56.787125 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:56.904620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Getting quotas for project a646ac1b653b49fb80c05ad567f29710. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:56.919336 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Getting quotas for user 8e1c70920a8a43999c308c8f595b4528 and project a646ac1b653b49fb80c05ad567f29710. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:56.944346 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:32:56.964380 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:32:57.181340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-87b92c01-67dd-492e-89b6-9994e007ec37 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.366826 Aug 24 12:32:57.182422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 16/39] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 5369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:32:57.195182 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c97f1eb3-1bc0-4321-8a4b-d195688ae6a6 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:57.196010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c97f1eb3-1bc0-4321-8a4b-d195688ae6a6 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:57.495018 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c97f1eb3-1bc0-4321-8a4b-d195688ae6a6 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:57.557536 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c97f1eb3-1bc0-4321-8a4b-d195688ae6a6 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1215 microversion: 2.1 time: 0.363086 Aug 24 12:32:57.560911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 24/40] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:57 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1215 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:57.806176 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1690401723", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99d8ab94-72d1-43ac-bae0-de280712c5bd"}], "security_groups": [{"name": "tempest-securitygroup--883854313"}], "key_name": "tempest-keypair-2030226403", "user_data": "}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:58.067011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] validate_networks() for [('99d8ab94-72d1-43ac-bae0-de280712c5bd', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:58.945856 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1222865992", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:32:59.169155 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] validate_networks() for [('b00813ec-943f-4d2b-8732-2fdea8f78407', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:32:59.269124 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:32:59.269652 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:32:59.270269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:32:59.270677 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:32:59.271281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:32:59.302159 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:59.303874 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:59.305265 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:59.306108 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:32:59.306571 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:32:59.306995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:32:59.414783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Getting quotas for project 96fea11cfdd748bab1cdea46b073dc89. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:32:59.434379 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Getting quotas for user 85d8138d44bc40dd8f63ee4916ffbce9 and project 96fea11cfdd748bab1cdea46b073dc89. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:32:59.483305 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:32:59.492479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:32:59.657230 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0fe864de-deb9-4be6-9eb9-54ec6986950b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.852297 Aug 24 12:32:59.662732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 17/41] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:32:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:32:59.683828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-32c1fa9a-04c7-443b-88ca-d2059bb7f074 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:59.686659 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-32c1fa9a-04c7-443b-88ca-d2059bb7f074 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:32:59.930458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-32c1fa9a-04c7-443b-88ca-d2059bb7f074 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:32:59.960909 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-32c1fa9a-04c7-443b-88ca-d2059bb7f074 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1215 microversion: 2.1 time: 0.289049 Aug 24 12:32:59.963083 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 18/42] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:59 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1215 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:32:59.984196 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-17bd9865-3d1e-4832-8a89-921666159d7e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:32:59.985933 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-17bd9865-3d1e-4832-8a89-921666159d7e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:00.104780 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-17bd9865-3d1e-4832-8a89-921666159d7e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:00.119718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-17bd9865-3d1e-4832-8a89-921666159d7e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1238 microversion: 2.1 time: 0.150193 Aug 24 12:33:00.134543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 19/43] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:32:59 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1238 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:00.988870 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:00.990296 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:01.004482 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.005757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.007979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.009488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.012525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.013168 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.598987 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:01.631184 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d3a688f5-97a7-46d4-b7b8-39b883eceb99 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1267 microversion: 2.1 time: 0.650647 Aug 24 12:33:01.632339 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 20/44] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:00 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1267 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:01.637563 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:01.638358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:01.677293 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.686326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.686808 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.687716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.688193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.688624 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.728640 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:33:01.729816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:33:01.739491 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:33:01.742569 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:33:01.743129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:33:01.765796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.766390 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.767596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.769572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:01.770588 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:01.773573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:01.836834 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Getting quotas for project 3276a7bc6bb84ac7953d2d46c4298a23. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:33:01.850418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Getting quotas for user e34cbcf69b4b4828a3bca077fc8d0694 and project 3276a7bc6bb84ac7953d2d46c4298a23. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:33:01.871399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:33:01.878648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:33:02.019931 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-690c3507-3528-4a38-acef-8a50a6306834 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.051790 Aug 24 12:33:02.020907 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 25/45] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:32:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 4053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:33:02.035546 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-180382285", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bd462f6-55a5-43db-8eee-5cc12a9f44b1"}], "security_groups": [{"name": "tempest-securitygroup--848836463"}], "key_name": "tempest-keypair-1702239500", "user_data": "}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:02.107142 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.116118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fae73333-a813-42b3-8739-915d93fd410c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1242 microversion: 2.1 time: 0.482461 Aug 24 12:33:02.129701 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 21/46] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:01 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1242 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:02.146532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fc8a9fa9-3c49-4e77-b929-a52776317f0e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:02.147155 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fc8a9fa9-3c49-4e77-b929-a52776317f0e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:02.592391 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fc8a9fa9-3c49-4e77-b929-a52776317f0e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:02.604397 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fc8a9fa9-3c49-4e77-b929-a52776317f0e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1222 microversion: 2.1 time: 0.468967 Aug 24 12:33:02.620678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 22/47] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:02 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1222 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:02.654337 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:02.655083 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:02.669075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.669816 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.670793 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.672918 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:02.675147 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:02.675643 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:02.675916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] validate_networks() for [('3bd462f6-55a5-43db-8eee-5cc12a9f44b1', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:33:03.002620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:03.013899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d480a7b0-0790-450a-b4c2-ad4db1835147 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1273 microversion: 2.1 time: 0.361096 Aug 24 12:33:03.015132 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:02 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1273 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:03.138123 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:03.139785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:03.149741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.151554 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.152883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.154932 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:03.156361 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:03.158424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:03.356398 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:03.380128 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8878b43e-93df-4f99-b914-df018dc114a1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1298 microversion: 2.1 time: 0.246591 Aug 24 12:33:03.388149 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 24/49] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:03 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1298 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:03.426420 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2013790044", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:03.520921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] validate_networks() for [('b00813ec-943f-4d2b-8732-2fdea8f78407', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:33:04.863487 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:33:04.864006 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:33:04.868509 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:33:04.869005 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:33:04.871863 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:33:04.895558 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.896349 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.897044 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.898213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:04.899035 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:04.899665 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:04.929189 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for project 75590a43f50b48699fc0d5a892a99544. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:33:04.945786 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for user b4a617fc13534a89ad50a5fdc7bf769a and project 75590a43f50b48699fc0d5a892a99544. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:33:04.991458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:33:04.993845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:33:05.102285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-356fb549-a8e5-4723-a814-7a0a4567e6fb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.079564 Aug 24 12:33:05.104121 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:33:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 3082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:33:05.110239 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:05.111166 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:05.119870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.120674 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.121259 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.122997 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.123612 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.124212 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.843213 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:33:05.846704 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:33:05.848290 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:33:05.852039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:33:05.852690 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:33:05.928543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.929834 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.936568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:05.938506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:05.942556 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:05.943017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.024252 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.053654 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Getting quotas for project 3276a7bc6bb84ac7953d2d46c4298a23. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:33:06.057522 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4293b0f9-8923-45d7-93f3-589fd74d301a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1273 microversion: 2.1 time: 0.949573 Aug 24 12:33:06.064234 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 27/51] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:05 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1273 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:06.070146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:06.078398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:06.079938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Getting quotas for user e34cbcf69b4b4828a3bca077fc8d0694 and project 3276a7bc6bb84ac7953d2d46c4298a23. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:33:06.103205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.106603 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.113208 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.114317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:06.114823 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:06.115320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:06.129397 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:33:06.136576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:33:06.288508 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fb75dbcc-a8a9-40ce-8209-8ae172742293 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.893488 Aug 24 12:33:06.289267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 25/52] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:33:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:33:06.311219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b97fcf78-13bf-45d8-b026-fcbb024cc764 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:06.314959 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b97fcf78-13bf-45d8-b026-fcbb024cc764 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:06.689844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b97fcf78-13bf-45d8-b026-fcbb024cc764 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.722314 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b97fcf78-13bf-45d8-b026-fcbb024cc764 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1241 microversion: 2.1 time: 0.431437 Aug 24 12:33:06.737946 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 26/53] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:06 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1241 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:06.743371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-4e014b3e-f281-4902-a880-53da4cfd437e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:06.745398 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-4e014b3e-f281-4902-a880-53da4cfd437e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:06.900330 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:06.921328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-033db2df-0dde-4c75-a225-314e84354705 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.855075 Aug 24 12:33:06.929554 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 28/54] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:06 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:07.080673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.081355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.084239 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-4e014b3e-f281-4902-a880-53da4cfd437e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:07.096276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-4e014b3e-f281-4902-a880-53da4cfd437e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1222 microversion: 2.1 time: 0.356754 Aug 24 12:33:07.101458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 27/55] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:06 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1222 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:07.108473 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.109238 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.113438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.116484 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.121649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.125419 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.497067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:07.512756 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a07f9561-a886-4dc2-a181-244a1549d438 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1273 microversion: 2.1 time: 0.432886 Aug 24 12:33:07.537048 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 29/56] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1273 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:07.744571 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.745491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.754155 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.762262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.769127 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.771190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.777279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.778925 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.951989 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:07.952849 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:07.969043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.972694 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.973289 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:07.974131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:07.974943 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:07.982170 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.520419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.539176 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6aecf18f-1ae8-4637-8e54-53d7b6050f23 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1293 microversion: 2.1 time: 0.798307 Aug 24 12:33:08.539758 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 28/57] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1293 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:08.567825 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:08.568452 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:08.601788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.604122 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.605561 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.610653 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:08.615122 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:08.617267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:08.967518 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:08.984303 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e35134dd-294c-4dca-b091-c4d853eab733 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1226 microversion: 2.1 time: 0.443454 Aug 24 12:33:08.998368 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 29/58] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:08 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1226 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:09.003838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:09.007538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:09.023028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.029056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.029936 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:09.033095 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:09.033759 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:09.034343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.458947 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:10.467197 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8d679e65-48ed-466f-8519-b00986908a1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 2.518856 Aug 24 12:33:10.469083 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 30/59] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:07 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:10.485872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:10.486498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:10.499916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=8 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:10.524422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.530013 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.537697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:10.540243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:10.540985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:10.541435 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.462294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:11.474917 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5856d067-6b6c-46c6-bf91-0f1a2c55068c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1299 microversion: 2.1 time: 1.004690 Aug 24 12:33:11.482906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 31/60] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:10 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1299 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:11.492980 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:11.500070 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:11.515669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.524169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.526254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.528100 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.530333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.530935 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.643158 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:11.664541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a2a0e5bb-5cdf-4fb5-afe6-5f1149bb47c8 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 2.664736 Aug 24 12:33:11.669825 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 30/61] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:08 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 2671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:11.812636 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:11.829365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-629eda78-8fcb-4501-8282-5934129919c7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1280 microversion: 2.1 time: 0.344345 Aug 24 12:33:11.832835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 32/62] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:11 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1280 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:11.849672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:11.852473 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:11.875870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.877824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.883269 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.889248 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.890129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.890766 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:11.897198 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-2fa8a817-98be-4a5c-803e-6a25021ff10c req-fb393192-c43b-4329-9e64-507e08ab7f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0c5601-af7b-4464-a37d-63b475832ae5", "tag": "044abc21-c178-491b-a6ae-f86df02d67c5"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:11.946312 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-2fa8a817-98be-4a5c-803e-6a25021ff10c req-fb393192-c43b-4329-9e64-507e08ab7f76 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:11.946801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-2fa8a817-98be-4a5c-803e-6a25021ff10c req-fb393192-c43b-4329-9e64-507e08ab7f76 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:11.947228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-2fa8a817-98be-4a5c-803e-6a25021ff10c req-fb393192-c43b-4329-9e64-507e08ab7f76 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.046158 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-2fa8a817-98be-4a5c-803e-6a25021ff10c req-fb393192-c43b-4329-9e64-507e08ab7f76 service nova] Creating event network-changed:044abc21-c178-491b-a6ae-f86df02d67c5 for instance 0c0c5601-af7b-4464-a37d-63b475832ae5 on hv-cinder-84605 Aug 24 12:33:12.047714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-2fa8a817-98be-4a5c-803e-6a25021ff10c req-fb393192-c43b-4329-9e64-507e08ab7f76 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127299) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 12:33:12.049462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-2fa8a817-98be-4a5c-803e-6a25021ff10c req-fb393192-c43b-4329-9e64-507e08ab7f76 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127299) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 12:33:12.055321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.056040 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.057460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.060262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.061795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.063135 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.093724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.compute.rpcapi [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 12:33:12.094946 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] Releasing lock "compute-rpcapi-router" {{(pid=127299) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 12:33:12.138445 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-639f6851-65c5-4415-8690-36b431c8bbcd None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.464242 Aug 24 12:33:12.139770 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 31/63] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:12.505915 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:12.506699 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:12.527797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.529486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.530269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.531850 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.535826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.537309 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.800193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:12.816971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-25de7395-afe1-4c3b-8735-1945f0729538 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1299 microversion: 2.1 time: 0.311193 Aug 24 12:33:12.818357 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 32/64] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:12 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1299 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:12.833881 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:12.834906 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:12.846063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.846568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.847010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:12.848003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:12.848525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:12.855166 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.007975 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.050144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-01a588b2-d7dd-4a26-a84b-a6f3c6380d7c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 1.214298 Aug 24 12:33:13.072020 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 33/65] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:11 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:13.098453 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:13.100802 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:13.109306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.110042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.110735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.111598 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.116959 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.117649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.349413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.382534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e7d53721-666e-41bf-b5e4-340a705e07db tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1280 microversion: 2.1 time: 0.294263 Aug 24 12:33:13.385589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 34/66] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:13 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:13.546940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:13.565697 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-136cd799-b7d6-402b-9ce3-68333e5d5960 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.745135 Aug 24 12:33:13.566963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 33/67] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:12 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:13.842621 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:13.844037 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:13.863351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.864107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.865792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:13.867655 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:13.872052 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:13.875146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.074996 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:14.075677 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:14.083387 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.083973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.084374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.089778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.093562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.094315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.194141 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:14.203334 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e79542ef-a9d5-49cb-98f2-94342c29889c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1299 microversion: 2.1 time: 0.366840 Aug 24 12:33:14.225248 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 35/68] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:13 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1299 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:14.414831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:14.416450 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:14.427694 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.428613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.436350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.437677 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:14.438233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:14.439239 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:14.916107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=4 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:14.975158 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=22 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:15.242182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:15.259273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-4e21aab5-246d-423b-88b8-259710391379 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 1.184482 Aug 24 12:33:15.269501 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 34/69] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:14 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:15.291381 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:15.291936 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:15.307340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.307842 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.308403 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:15.311657 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:15.312160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:15.312610 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.561692 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.579679 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9892f82a-1ac1-4fe5-912c-8ad35ebc17d9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 1.306173 Aug 24 12:33:16.593762 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 35/70] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:15 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:16.616177 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:16.617772 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:16.621935 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:16.642694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.643454 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.644153 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.645386 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.650472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.651134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.700750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:16.718149 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0060219f-8864-4f5b-a4dc-60febf993f34 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 2.307176 Aug 24 12:33:16.728036 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 36/71] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:14 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:16.748513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:16.749283 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:16.778726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.780064 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.781500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:16.787639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:16.788355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:16.791666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.093363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=28 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:17.824478 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:17.852581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e8c85ae8-67e6-42dc-b1d3-2808eeb90d42 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 1.122992 Aug 24 12:33:17.853565 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 37/72] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:16 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:17.866735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-9c1eef0b-26fd-4b54-a997-dfe1440ea0c2 req-13331ae8-aee5-4570-b6d2-860d9970e1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6982a702-24f0-405c-8928-60dce62be5c5", "tag": "7e5498b6-b445-42d1-9bfa-73ca88c03b12"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:17.911307 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9c1eef0b-26fd-4b54-a997-dfe1440ea0c2 req-13331ae8-aee5-4570-b6d2-860d9970e1ea service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:17.913174 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9c1eef0b-26fd-4b54-a997-dfe1440ea0c2 req-13331ae8-aee5-4570-b6d2-860d9970e1ea service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:17.916033 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9c1eef0b-26fd-4b54-a997-dfe1440ea0c2 req-13331ae8-aee5-4570-b6d2-860d9970e1ea service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:17.951467 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:17.992192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e06d579f-fa80-447a-bfdb-12193888b542 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 1.389630 Aug 24 12:33:17.997242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 36/73] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:16 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:18.030300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-9c1eef0b-26fd-4b54-a997-dfe1440ea0c2 req-13331ae8-aee5-4570-b6d2-860d9970e1ea service nova] Creating event network-changed:7e5498b6-b445-42d1-9bfa-73ca88c03b12 for instance 6982a702-24f0-405c-8928-60dce62be5c5 on hv-cinder-84605 Aug 24 12:33:18.031054 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9c1eef0b-26fd-4b54-a997-dfe1440ea0c2 req-13331ae8-aee5-4570-b6d2-860d9970e1ea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 12:33:18.031565 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9c1eef0b-26fd-4b54-a997-dfe1440ea0c2 req-13331ae8-aee5-4570-b6d2-860d9970e1ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=127298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 12:33:18.034222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.048418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.049089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.055700 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.059797 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.060483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.097915 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.compute.rpcapi [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 12:33:18.100884 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] Releasing lock "compute-rpcapi-router" {{(pid=127298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 12:33:18.144270 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-935ba0a1-236c-47a8-b1a4-6cdf921dce26 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286308 Aug 24 12:33:18.149333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 38/74] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:18.168388 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:18.169148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:18.195546 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.196054 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.196501 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.199485 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.199977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.200406 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.398081 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-a7cd8619-72fd-4bd8-b5e9-b90e9361a58d req-89f74b9b-bec8-4f81-b15c-23240088eecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718c8878-059c-4ccf-9928-700abc374250", "tag": "d979cb7e-4b54-4cc1-924f-eb17d71b5876"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:18.430650 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a7cd8619-72fd-4bd8-b5e9-b90e9361a58d req-89f74b9b-bec8-4f81-b15c-23240088eecb service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.436390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a7cd8619-72fd-4bd8-b5e9-b90e9361a58d req-89f74b9b-bec8-4f81-b15c-23240088eecb service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.436985 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a7cd8619-72fd-4bd8-b5e9-b90e9361a58d req-89f74b9b-bec8-4f81-b15c-23240088eecb service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.501370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-a7cd8619-72fd-4bd8-b5e9-b90e9361a58d req-89f74b9b-bec8-4f81-b15c-23240088eecb service nova] Creating event network-changed:d979cb7e-4b54-4cc1-924f-eb17d71b5876 for instance 718c8878-059c-4ccf-9928-700abc374250 on hv-cinder-84605 Aug 24 12:33:18.518994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-a7cd8619-72fd-4bd8-b5e9-b90e9361a58d req-89f74b9b-bec8-4f81-b15c-23240088eecb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.519563 Aug 24 12:33:18.522520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 37/75] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:18.533000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:18.533825 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:18.557219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.558196 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.558795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.559719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.560340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.561109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.932441 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:18.955375 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-55147d1f-e0ea-4b58-bdd7-1b47e89f693a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.803902 Aug 24 12:33:18.956300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 39/76] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:18 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:18.964565 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:18.967629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:18.987565 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.988089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.988532 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:18.990972 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:18.991443 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:18.993191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.346814 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:19.355880 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-dcf95c94-a3d3-4d4e-806f-cdce490f8f75 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 0.828815 Aug 24 12:33:19.357109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 38/77] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:18 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:19.365971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:19.367018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:19.375558 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.376173 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.377216 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.378237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.380109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.381389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.803058 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:19.824707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c570feec-471d-4c39-a5a4-22e4d9575556 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.867284 Aug 24 12:33:19.825311 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 40/78] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:18 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:19.949447 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:19.968325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fb3fef1f-4ca9-4d1a-b1e2-b49deada6383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.607382 Aug 24 12:33:19.975758 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:19.977129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:19.988207 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.988797 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.989129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:19.989981 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:19.990979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 39/79] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:19 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:19.991619 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:19.992040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.365971 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:20.383147 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:20.383772 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:20.387150 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-58957fb7-a86c-4f1f-a815-f4c1d65de769 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.415302 Aug 24 12:33:20.388208 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 41/80] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:19 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:20.406173 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.406784 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.407442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.419598 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.421296 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.423291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.476562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:20.632792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-1e0d529f-c8c0-4abc-889a-52d9ef32cea0 req-d7a10883-5abd-4c6d-90ed-be92bf8eef92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336ccc96-8289-4d8f-a2e0-6ee9d99345d7", "tag": "8365150b-d0c5-46c0-a2b9-015d30aacc99"}, {"name": "network-changed", "server_uuid": "056ae6fc-add8-4682-ad3d-ab4072db60f5", "tag": "238da6cc-198a-4e0a-9122-8d7624a1ce5d"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:20.645893 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1e0d529f-c8c0-4abc-889a-52d9ef32cea0 req-d7a10883-5abd-4c6d-90ed-be92bf8eef92 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.646650 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1e0d529f-c8c0-4abc-889a-52d9ef32cea0 req-d7a10883-5abd-4c6d-90ed-be92bf8eef92 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.647085 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1e0d529f-c8c0-4abc-889a-52d9ef32cea0 req-d7a10883-5abd-4c6d-90ed-be92bf8eef92 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.661950 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-1e0d529f-c8c0-4abc-889a-52d9ef32cea0 req-d7a10883-5abd-4c6d-90ed-be92bf8eef92 service nova] Creating event network-changed:8365150b-d0c5-46c0-a2b9-015d30aacc99 for instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 on hv-cinder-84605 Aug 24 12:33:20.662397 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-1e0d529f-c8c0-4abc-889a-52d9ef32cea0 req-d7a10883-5abd-4c6d-90ed-be92bf8eef92 service nova] Creating event network-changed:238da6cc-198a-4e0a-9122-8d7624a1ce5d for instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 on hv-cinder-84605 Aug 24 12:33:20.668641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-1e0d529f-c8c0-4abc-889a-52d9ef32cea0 req-d7a10883-5abd-4c6d-90ed-be92bf8eef92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040297 Aug 24 12:33:20.669312 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 42/81] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:20.846717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:20.847773 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:20.860367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.861978 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.862833 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.863944 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:20.864849 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:20.869796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:20.891328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:20.905088 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-797bb1d5-102c-4565-b337-8080bfd6b800 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 0.526106 Aug 24 12:33:20.909515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 40/82] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:20 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:21.005486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:21.006453 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:21.016609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.017215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.017849 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.019063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.020612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.021070 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.152109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.158124 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:21.166837 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6c764cb8-f485-4668-be51-50c94c8b0632 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.324974 Aug 24 12:33:21.167987 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 43/83] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:20 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:21.236920 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.248545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-421483a6-b922-4937-8daa-decce60210ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.245991 Aug 24 12:33:21.249970 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 41/84] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:20 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:21.409559 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:21.410174 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:21.417735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.418456 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.419113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.420817 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.421397 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.421872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.582812 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:21.595805 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d77841e3-c15d-4b90-a2ea-c09bc1fb0aab tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.190290 Aug 24 12:33:21.605222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 44/85] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:21 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:21.932373 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:21.933026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:21.939565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.940370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.940860 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:21.941563 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:21.942013 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:21.942427 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.081102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:22.083617 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=8 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:22.091438 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e8fd615c-04ca-417d-9ee8-0c567237fc91 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 0.163719 Aug 24 12:33:22.092696 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 42/86] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:21 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:22.187865 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:22.189540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:22.202973 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.204974 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.206068 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.207580 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.210775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.211729 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.271818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:22.272869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:22.280848 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.281748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.282507 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.283646 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.284483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.285138 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.724228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:22.729759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:22.739130 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ecdd9578-afdc-423c-9fc7-6b97e55060f6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.471946 Aug 24 12:33:22.740721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 43/87] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:22 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:22.747134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:22.748017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:22.748825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-37f4fb69-1326-4727-96b8-c922d5cb8d91 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.565195 Aug 24 12:33:22.749413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 45/88] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:22 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:22.755578 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.756419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.757092 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:22.758565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:22.759530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:22.760279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.116751 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:23.118759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:23.120168 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:23.130308 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f7624c01-7522-4e01-b090-1e129f5d7bcb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.388245 Aug 24 12:33:23.145984 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 44/89] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:22 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:23.160773 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.162043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.166873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.168266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.169214 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.169903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.775908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:23.776549 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:23.788188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.789102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.789944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:23.790956 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:23.791901 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:23.792596 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.207628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.217462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9657979b-e13e-4bdb-abce-0ef0263ca4b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 1.107548 Aug 24 12:33:24.218726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 46/90] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:23 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:24.223954 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:24.224878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:24.234561 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.237668 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.238456 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.239603 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.240259 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.241408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.356940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.365516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ae3f5381-17f5-4176-ba96-46191d7634cd tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.593689 Aug 24 12:33:24.368796 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 45/91] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:23 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:24.377457 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:24.378353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:24.389683 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.390957 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.391615 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.392818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:24.393654 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:24.394223 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:24.729649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.742858 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-34223813-8c51-4dd8-9925-a9efc943328b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.522233 Aug 24 12:33:24.745989 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 47/92] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:24 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:24.897052 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:24.908311 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-07df6162-11e4-4c17-b77c-3773e0e48081 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.537748 Aug 24 12:33:24.926387 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 46/93] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:24 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:25.242148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.244741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.260001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.260855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.261470 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.262357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.262984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.265329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.392916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.394140 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.403911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.405693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.407209 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.409326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.411935 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.412624 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.737785 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:25.753188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-02a5d29c-d360-41a3-b21c-2094ff630ee9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 0.517344 Aug 24 12:33:25.755019 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 48/94] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:25.771702 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.772678 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.773895 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:25.779954 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.780890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.781515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.782751 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.783516 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.784386 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.787632 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-357bd4a0-b9b6-45c7-b650-6b51eac0f19f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.399988 Aug 24 12:33:25.789601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 47/95] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:25.933436 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:25.934042 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:25.948731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.949439 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.949891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:25.956422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:25.957023 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:25.957466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:26.074091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:26.083122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6b6f5890-34d0-4ddf-b1bc-81252138ecae tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.315217 Aug 24 12:33:26.095797 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 49/96] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:26.220942 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:26.237251 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c8127fdd-1663-466d-aacd-62f479a6bd86 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.306648 Aug 24 12:33:26.240805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 48/97] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:25 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:26.773416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:26.774080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:26.783295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:26.783786 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:26.784221 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:26.786730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:26.787014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:26.787749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:26.811706 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:26.812545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:26.831206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:26.831206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:26.831206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:26.831206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:26.831461 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:26.831461 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.069739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.078307 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3372d65b-b71e-40d2-966a-485af2030b13 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.270531 Aug 24 12:33:27.081134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 49/98] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:26 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:27.137006 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.152066 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6a954f90-1822-4d80-9dba-65d1244f66d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 0.382496 Aug 24 12:33:27.157116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 50/99] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:26 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:27.172254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:27.173792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:27.189081 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.189978 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.190419 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.191138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.191592 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.192056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.377247 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.388182 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dd414848-741f-402d-a43f-43eb29c5ba4b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.228487 Aug 24 12:33:27.389358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 51/100] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:27 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:27.394158 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:27.394984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:27.401759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.402484 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.403183 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.411105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.412080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.413274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.484389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-11eb0346-bdac-413e-bd65-f5ec61e3f61c req-df4960b6-e0e8-40b8-a1ca-1f57e1e9d156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0c5601-af7b-4464-a37d-63b475832ae5", "name": "network-vif-plugged", "status": "completed", "tag": "044abc21-c178-491b-a6ae-f86df02d67c5"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:27.507258 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-11eb0346-bdac-413e-bd65-f5ec61e3f61c req-df4960b6-e0e8-40b8-a1ca-1f57e1e9d156 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:27.507780 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-11eb0346-bdac-413e-bd65-f5ec61e3f61c req-df4960b6-e0e8-40b8-a1ca-1f57e1e9d156 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:27.508256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-11eb0346-bdac-413e-bd65-f5ec61e3f61c req-df4960b6-e0e8-40b8-a1ca-1f57e1e9d156 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:27.534256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-11eb0346-bdac-413e-bd65-f5ec61e3f61c req-df4960b6-e0e8-40b8-a1ca-1f57e1e9d156 service nova] Creating event network-vif-plugged:044abc21-c178-491b-a6ae-f86df02d67c5 for instance 0c0c5601-af7b-4464-a37d-63b475832ae5 on hv-cinder-84605 Aug 24 12:33:27.544817 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-11eb0346-bdac-413e-bd65-f5ec61e3f61c req-df4960b6-e0e8-40b8-a1ca-1f57e1e9d156 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.462421 Aug 24 12:33:27.547963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 50/101] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:27.634566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:27.645439 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1dc2b720-196a-403f-8921-8832e74e2f73 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.254847 Aug 24 12:33:27.661724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 52/102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:27 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:28.102154 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.102945 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.112537 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.113732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.114851 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.118141 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.119806 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.120508 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.182359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.183893 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.201067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:28.208139 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.208637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.209096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.210661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.211430 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.211864 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.346276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:28.362285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-af57b2b4-fd2e-40e1-acee-c643c76ca659 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.264155 Aug 24 12:33:28.366179 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 51/103] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:28.408406 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:28.411094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.412002 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.418984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6cd322a0-0fc3-43cd-b3b5-831cc30b0026 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 0.244985 Aug 24 12:33:28.419568 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 53/104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:28.431795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.432865 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.433318 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.434183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.434633 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.435057 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.573843 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:28.584051 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-16edefc7-06d5-4114-a7b2-848d149dddc8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.177593 Aug 24 12:33:28.584757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 52/105] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:28.669564 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:28.670246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:28.676874 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.677745 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.678625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.679505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:28.679982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:28.680394 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:28.847613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:28.856023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0db11a33-bfdc-4920-a35d-4b9420c5dcb3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.190361 Aug 24 12:33:28.857032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 54/106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:28 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:29.383231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:29.384572 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:29.392747 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.393240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.394211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.395028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.395504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.396328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.443787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:29.444459 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:29.456209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.456771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.458378 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.459130 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.461883 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.462304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.614522 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:29.630621 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ad4ab998-d9fc-4fc8-b2d9-ddcbe3b9ffaf tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1363 microversion: 2.1 time: 0.249779 Aug 24 12:33:29.631452 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 53/107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:29 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:29.652045 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-858f782c-b627-448c-8dc3-f63bb51f46cd req-380f164e-59b3-45df-af3d-0140a3489eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6982a702-24f0-405c-8928-60dce62be5c5", "name": "network-vif-plugged", "status": "completed", "tag": "7e5498b6-b445-42d1-9bfa-73ca88c03b12"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:29.675773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-858f782c-b627-448c-8dc3-f63bb51f46cd req-380f164e-59b3-45df-af3d-0140a3489eed service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.676527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-858f782c-b627-448c-8dc3-f63bb51f46cd req-380f164e-59b3-45df-af3d-0140a3489eed service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.677488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-858f782c-b627-448c-8dc3-f63bb51f46cd req-380f164e-59b3-45df-af3d-0140a3489eed service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.700521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-858f782c-b627-448c-8dc3-f63bb51f46cd req-380f164e-59b3-45df-af3d-0140a3489eed service nova] Creating event network-vif-plugged:7e5498b6-b445-42d1-9bfa-73ca88c03b12 for instance 6982a702-24f0-405c-8928-60dce62be5c5 on hv-cinder-84605 Aug 24 12:33:29.718341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-858f782c-b627-448c-8dc3-f63bb51f46cd req-380f164e-59b3-45df-af3d-0140a3489eed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083148 Aug 24 12:33:29.721412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 54/108] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:29.723704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:29.736910 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:29.738760 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:29.746532 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7688103a-dce6-453a-baa7-ac1538d1e502 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 0.307441 Aug 24 12:33:29.746532 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 55/109] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:29 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:29.759736 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.760230 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.760696 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.761387 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.761832 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.762245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.877673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:29.878303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:29.887666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.891118 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.891845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:29.894997 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:29.895792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:29.896421 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.138315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:30.151338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7bdc9352-bbe8-4208-b762-b63780cfff6a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.428442 Aug 24 12:33:30.151913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 55/110] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:29 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:30.394815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:30.404994 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f95db6a6-5f99-44f5-9aa9-f258960f5ed3 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.531427 Aug 24 12:33:30.406689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 56/111] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:29 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:30.653262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:30.654656 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:30.661796 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.664009 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.664458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.665188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.665638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.666054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.766627 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:30.768055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:30.778906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.779586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.780044 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.781695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.784698 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.788836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.904422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:30.918382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e593145c-311f-423d-a08a-14824bf4f7a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1550 microversion: 2.1 time: 0.267012 Aug 24 12:33:30.918982 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 56/112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:30 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1550 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:30.947407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:30.947908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:30.959723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.961356 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.961686 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:30.962393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:30.962853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:30.963258 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.080539 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:31.089935 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8e810186-5728-4f86-8361-cd49d37fc760 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1322 microversion: 2.1 time: 0.328521 Aug 24 12:33:31.090462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 57/113] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:30 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:31.140045 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b8bf753b-6b61-4064-9da9-f6224efec5e3 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203992 Aug 24 12:33:31.140619 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 57/114] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 12:33:30 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:31.185227 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:31.186022 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:31.193829 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.194457 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.195036 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.195723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.196299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.196897 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.429086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:31.429718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:31.445787 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.446299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.446740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.450128 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.450631 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.451074 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.669206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:31.681564 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-34b718ec-4385-4ea5-a479-fd941810ff48 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.500106 Aug 24 12:33:31.685733 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 58/115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:31 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:31.740167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-cab0c453-2f3a-438e-98cf-5737b0765074 req-f89df387-2065-4f7b-afd3-dc426dbd1fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718c8878-059c-4ccf-9928-700abc374250", "name": "network-vif-plugged", "status": "completed", "tag": "d979cb7e-4b54-4cc1-924f-eb17d71b5876"}, {"server_uuid": "336ccc96-8289-4d8f-a2e0-6ee9d99345d7", "name": "network-vif-plugged", "status": "completed", "tag": "8365150b-d0c5-46c0-a2b9-015d30aacc99"}, {"server_uuid": "056ae6fc-add8-4682-ad3d-ab4072db60f5", "name": "network-vif-plugged", "status": "completed", "tag": "238da6cc-198a-4e0a-9122-8d7624a1ce5d"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:31.759053 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-cab0c453-2f3a-438e-98cf-5737b0765074 req-f89df387-2065-4f7b-afd3-dc426dbd1fa5 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:31.761649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-cab0c453-2f3a-438e-98cf-5737b0765074 req-f89df387-2065-4f7b-afd3-dc426dbd1fa5 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:31.762217 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-cab0c453-2f3a-438e-98cf-5737b0765074 req-f89df387-2065-4f7b-afd3-dc426dbd1fa5 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:31.807233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-cab0c453-2f3a-438e-98cf-5737b0765074 req-f89df387-2065-4f7b-afd3-dc426dbd1fa5 service nova] Creating event network-vif-plugged:d979cb7e-4b54-4cc1-924f-eb17d71b5876 for instance 718c8878-059c-4ccf-9928-700abc374250 on hv-cinder-84605 Aug 24 12:33:31.807808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-cab0c453-2f3a-438e-98cf-5737b0765074 req-f89df387-2065-4f7b-afd3-dc426dbd1fa5 service nova] Creating event network-vif-plugged:8365150b-d0c5-46c0-a2b9-015d30aacc99 for instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 on hv-cinder-84605 Aug 24 12:33:31.808183 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-cab0c453-2f3a-438e-98cf-5737b0765074 req-f89df387-2065-4f7b-afd3-dc426dbd1fa5 service nova] Creating event network-vif-plugged:238da6cc-198a-4e0a-9122-8d7624a1ce5d for instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 on hv-cinder-84605 Aug 24 12:33:31.831509 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:31.832800 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-cab0c453-2f3a-438e-98cf-5737b0765074 req-f89df387-2065-4f7b-afd3-dc426dbd1fa5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093561 Aug 24 12:33:31.834658 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 59/116] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:31.836844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:31.844843 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f98402b2-9465-42ed-877e-875d5461c16d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.421226 Aug 24 12:33:31.846271 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 58/117] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:31 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:32.111988 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:32.113138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.121831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.122586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.123173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.124070 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.124735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.125673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.455920 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:32.478012 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a10d4943-09ba-423e-9b4e-9f9248321f9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1517 microversion: 2.1 time: 0.370667 Aug 24 12:33:32.478817 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 60/118] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:32 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:32.502626 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:32.507340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.519191 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.521388 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.523096 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.524103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.527387 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.528805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.590091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lazy-loading 'flavor' on Instance uuid 6982a702-24f0-405c-8928-60dce62be5c5 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:33:32.705965 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:32.706583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.726400 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.734280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.734872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.738336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.738851 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.740413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.758358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:32.948957 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-210fe6a6-8cf9-4706-94e1-3e494c20232d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5/action" status: 200 len: 32 microversion: 2.1 time: 0.451787 Aug 24 12:33:32.951067 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 59/119] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:33:32 2022] POST /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:33:32.957840 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:32.959190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:32.966928 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.967640 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.968074 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:32.968963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:32.969551 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:32.970009 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.240191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:33.252572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f22444e3-142f-42b4-bb1f-6586d602025a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.550291 Aug 24 12:33:33.256828 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 61/120] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:32 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:33.263045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:33.263655 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:33.299582 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:33.301566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:33.302331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.303462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:33.304114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:33.305498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.347064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:33.362130 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9b0c2f87-5b19-4b3c-a7f6-ad4003acf79e tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.409523 Aug 24 12:33:33.363090 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 60/121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:32 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:33.460863 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-6a17e7c7-215f-4650-82c5-25876f03c3e0 req-810a8b0d-21cd-46e6-b44c-c0ad67739c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0c5601-af7b-4464-a37d-63b475832ae5", "tag": "044abc21-c178-491b-a6ae-f86df02d67c5"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:33.486196 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-6a17e7c7-215f-4650-82c5-25876f03c3e0 req-810a8b0d-21cd-46e6-b44c-c0ad67739c5e service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:33.487889 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-6a17e7c7-215f-4650-82c5-25876f03c3e0 req-810a8b0d-21cd-46e6-b44c-c0ad67739c5e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:33.489147 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-6a17e7c7-215f-4650-82c5-25876f03c3e0 req-810a8b0d-21cd-46e6-b44c-c0ad67739c5e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:33.517841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-6a17e7c7-215f-4650-82c5-25876f03c3e0 req-810a8b0d-21cd-46e6-b44c-c0ad67739c5e service nova] Creating event network-changed:044abc21-c178-491b-a6ae-f86df02d67c5 for instance 0c0c5601-af7b-4464-a37d-63b475832ae5 on hv-cinder-84605 Aug 24 12:33:33.528818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-6a17e7c7-215f-4650-82c5-25876f03c3e0 req-810a8b0d-21cd-46e6-b44c-c0ad67739c5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072259 Aug 24 12:33:33.530752 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 61/122] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:33.540720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:33.550391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ea4f8c82-4e35-44d4-893e-9a6dfd0bfa01 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.292169 Aug 24 12:33:33.565143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 62/123] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:33 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:34.275533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:34.276230 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:34.286919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.287404 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.287845 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.288539 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.289564 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.291354 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.383524 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:34.384845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:34.394788 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.396381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.399151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.400083 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.403604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.404317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.663281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:34.679434 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-41300185-1e85-4a5e-a66f-9ab2b2ea5c5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1366 microversion: 2.1 time: 0.407140 Aug 24 12:33:34.680042 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 62/124] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:34 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:34.696472 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:34.697477 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:34.698367 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:34.706979 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d4512a4f-452b-4b3f-b8db-04146e25c15b tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1315 microversion: 2.1 time: 0.326883 Aug 24 12:33:34.709872 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.710394 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.710829 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.711526 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:34.711975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:34.712393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:34.713513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 63/125] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:34 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:34.930755 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:34.940931 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1b20218a-ce70-44ff-9291-4c549fed7fb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.259799 Aug 24 12:33:34.956218 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 63/126] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:34 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:35.701291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:35.701969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:35.708985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.709470 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.712285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.713167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.713703 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.714167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.728419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:35.729933 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:35.740185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.741297 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.741705 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.742477 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.745345 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.746161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.948285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:35.957088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dd310525-7919-41d1-97da-ad18005df722 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1555 microversion: 2.1 time: 0.258982 Aug 24 12:33:35.962860 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 64/127] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:35 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:35.966748 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:35.967260 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:35.983312 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.984162 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.984901 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:35.985825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:35.986551 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:35.987201 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.166947 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:36.181937 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7dd3b590-6887-40c7-a1eb-eecac196a4cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1501 microversion: 2.1 time: 0.454173 Aug 24 12:33:36.194924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 64/128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:35 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1501 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:36.210330 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:36.210827 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:36.227247 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:36.227765 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:36.228193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.230425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:36.230881 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:36.231300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:36.460486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-aceb8c11-e95e-4a9c-8c2d-a3e51233028b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.258083 Aug 24 12:33:36.461091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 65/129] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 12:33:36 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:36.562501 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:36.582728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8cf0d57e-5880-4b27-b63f-b320e5fbd604 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.620404 Aug 24 12:33:36.584194 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 65/130] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:35 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:37.603893 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:37.604520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:37.623016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.623529 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.624247 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.625233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.625838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.626639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.822859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41bdadc2-6920-4158-a3c4-e3b5a0d16645"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:37.825945 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:37.832762 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.833492 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.834102 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:37.835033 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:37.835689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:37.836324 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:38.339768 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:38.348323 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f138a2e0-3226-4d30-8cc3-90900a74979f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.748438 Aug 24 12:33:38.353473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 66/131] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:37 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:38.444335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9617262e-336d-4618-89d9-aba3b5b30940 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "POST /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623473 Aug 24 12:33:38.446284 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 66/132] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:33:37 2022] POST /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:33:39.379463 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:39.380355 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:39.388182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.388790 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.389622 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.390546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.392203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.392913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.544491 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-601ada9d-9660-4ddc-8ae8-66018518e56f req-3968f8bb-0a4d-4b06-9cf4-042d010882db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056ae6fc-add8-4682-ad3d-ab4072db60f5", "tag": "238da6cc-198a-4e0a-9122-8d7624a1ce5d"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:39.576164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-601ada9d-9660-4ddc-8ae8-66018518e56f req-3968f8bb-0a4d-4b06-9cf4-042d010882db service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:39.576701 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-601ada9d-9660-4ddc-8ae8-66018518e56f req-3968f8bb-0a4d-4b06-9cf4-042d010882db service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:39.583717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-601ada9d-9660-4ddc-8ae8-66018518e56f req-3968f8bb-0a4d-4b06-9cf4-042d010882db service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:39.618584 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-601ada9d-9660-4ddc-8ae8-66018518e56f req-3968f8bb-0a4d-4b06-9cf4-042d010882db service nova] Creating event network-changed:238da6cc-198a-4e0a-9122-8d7624a1ce5d for instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 on hv-cinder-84605 Aug 24 12:33:39.632682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-601ada9d-9660-4ddc-8ae8-66018518e56f req-3968f8bb-0a4d-4b06-9cf4-042d010882db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090576 Aug 24 12:33:39.633503 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 67/133] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:33:39.678314 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:39.686451 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a53fdb57-6d8e-4bab-9ac6-b13a647f4ba3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.312174 Aug 24 12:33:39.687315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 67/134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:39 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:40.708806 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:40.709515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:40.718317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=74 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:40.720434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.721327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.721950 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.722823 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:40.723538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:40.724264 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:40.949202 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:40.963585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3917fb80-8c87-41f8-925f-9242c269d3a7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.260175 Aug 24 12:33:40.964431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 68/135] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:40 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:41.990171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:41.995565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:42.005766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.006678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.007344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.008576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:42.009274 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:42.009702 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:42.162632 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:42.170473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b92e1b4c-5073-4490-8b4c-53b1b27862b2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.185488 Aug 24 12:33:42.171029 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 68/136] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:41 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:43.197491 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:43.198106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:43.206845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:43.207675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:43.208276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:43.210377 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:43.210867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:43.211301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:43.372298 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:43.380717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c4d4befc-4d58-4c3f-8f9f-d69fb6c8fd8a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.193182 Aug 24 12:33:43.381284 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 69/137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:43 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:44.402434 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:44.403046 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:44.409356 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:44.410033 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:44.410459 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:44.411435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:44.412131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:44.412724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:44.567011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:44.575127 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3535e99c-85bf-4995-93b1-9b375ad0220b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.176769 Aug 24 12:33:44.575703 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 69/138] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:44 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:45.595434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:45.596035 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:45.602944 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.603628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.604128 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.605097 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:45.605956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:45.606508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:45.750035 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:45.767199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a44d2432-f817-47a4-bf55-e80a200ba1b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.175709 Aug 24 12:33:45.767792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 70/139] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:45 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:46.787424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:46.788118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:46.790315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=68 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:46.795835 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:46.796397 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:46.797639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:46.798410 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:46.798935 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:46.799550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:46.940219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:46.950190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1267b287-d48b-49e8-9e3a-294d2e3566f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.166663 Aug 24 12:33:46.951633 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 70/140] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:46 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:47.972199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:47.978817 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:47.985982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:47.986856 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:47.987286 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:47.988150 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:47.988594 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:47.989177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:48.257707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:48.277628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dc41465a-089b-4edc-a89e-b42b766c5532 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.309517 Aug 24 12:33:48.278218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 71/141] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:47 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:49.301819 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:49.303002 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:49.310098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.310786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.311560 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.312366 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.312908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.313291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.465946 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:49.467076 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:49.473607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.474338 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.474926 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.475681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.476193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.476790 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.504018 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:33:49.525962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:49.539720 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5a0f408a-bb33-4580-af38-6336458235fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.242927 Aug 24 12:33:49.555881 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 71/142] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:49 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:49.621879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fbb548e9-a727-44c8-8d12-faaaf5b06071 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "DELETE /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 204 len: 0 microversion: 2.1 time: 0.160177 Aug 24 12:33:49.622548 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 72/143] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:33:49 2022] DELETE /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:33:49.632974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:49.633772 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:49.641748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.643178 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.643826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.644698 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:49.645254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:49.646295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:49.834296 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:49.844542 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-79cf4b4c-8bea-44c7-bc65-87e2ca8afd51 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1553 microversion: 2.1 time: 0.216773 Aug 24 12:33:49.845478 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 72/144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:49 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:50.573427 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:50.575244 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:50.586307 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:50.587455 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:50.588206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:50.590808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:50.591658 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:50.592185 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:50.820806 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:50.830575 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5ac99cc4-e597-4ef0-b5c7-4011c35cc25a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.265671 Aug 24 12:33:50.831184 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 73/145] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:50 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:50.866217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:50.866957 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:50.876550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:50.879415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:50.879953 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:50.880929 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:50.881718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:50.883326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:51.032766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:51.041583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-82589294-47fc-423a-9633-4d2ca2ddb9c9 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1553 microversion: 2.1 time: 0.179589 Aug 24 12:33:51.042215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 73/146] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:50 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:51.851715 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:51.852307 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:51.859337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:51.860004 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:51.860451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:51.861329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:51.861790 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:51.862393 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.035462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:52.043536 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6c14653f-46f0-4cbb-8cad-8e368475ae02 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.195819 Aug 24 12:33:52.044497 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 74/147] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:51 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:52.064695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:52.065332 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:52.072277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:52.073004 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:52.073650 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.074535 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:52.075162 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:52.075752 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:52.100452 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:52.395383 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:52.404634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-df268bd6-c2f0-4334-b5c6-7390914e90ea tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1553 microversion: 2.1 time: 0.344427 Aug 24 12:33:52.417072 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 74/148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:52 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1553 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:53.065126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:53.066290 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:53.072975 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.073570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.074086 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.074883 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.075435 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.075950 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.095787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:33:53.192906 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-70944d76-3f9e-4ad8-9d90-c2a99ce268ae req-49a69033-6239-4adf-9f71-03ae30a8631a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718c8878-059c-4ccf-9928-700abc374250", "name": "network-vif-deleted", "tag": "d979cb7e-4b54-4cc1-924f-eb17d71b5876"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:33:53.206295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-70944d76-3f9e-4ad8-9d90-c2a99ce268ae req-49a69033-6239-4adf-9f71-03ae30a8631a service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.207056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-70944d76-3f9e-4ad8-9d90-c2a99ce268ae req-49a69033-6239-4adf-9f71-03ae30a8631a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.207470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-70944d76-3f9e-4ad8-9d90-c2a99ce268ae req-49a69033-6239-4adf-9f71-03ae30a8631a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.220162 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-70944d76-3f9e-4ad8-9d90-c2a99ce268ae req-49a69033-6239-4adf-9f71-03ae30a8631a service nova] Creating event network-vif-deleted:d979cb7e-4b54-4cc1-924f-eb17d71b5876 for instance 718c8878-059c-4ccf-9928-700abc374250 on hv-cinder-84605 Aug 24 12:33:53.226297 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-70944d76-3f9e-4ad8-9d90-c2a99ce268ae req-49a69033-6239-4adf-9f71-03ae30a8631a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038282 Aug 24 12:33:53.227697 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 75/149] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:33:53.307315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:53.315860 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-67969f7d-08c1-4103-9067-594b6f323bac tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.256438 Aug 24 12:33:53.328869 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 75/150] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:53 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:53.426870 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:53.427771 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:53.434260 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.434946 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.435508 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.436345 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:53.437407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:53.437762 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:53.506238 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:53.514474 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-db5e57b4-5db7-4477-a678-43410b07ca02 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1511 microversion: 2.1 time: 0.092067 Aug 24 12:33:53.515087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 76/151] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:53 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:54.339245 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:54.339840 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:54.346408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:54.346914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:54.347330 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:54.348021 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:54.348475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:54.348924 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:54.523172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:54.531909 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5ed3185c-8101-48bb-bd19-2961b929baa6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.196535 Aug 24 12:33:54.540921 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 76/152] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:54 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:54.542721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:54.544143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:54.552545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:54.553060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:54.553715 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:54.555240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:54.555727 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:54.556174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:54.626788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:54.635649 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2bdd698e-f6ba-4d73-88f7-efe559071249 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1511 microversion: 2.1 time: 0.103264 Aug 24 12:33:54.636400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 77/153] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:54 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1511 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:55.551819 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:55.552381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:55.559335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:55.559804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:55.560263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.560989 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:55.561444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:55.561859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.656533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:55.657171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:55.663901 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:55.664383 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:55.664832 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.665625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:55.665980 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:55.666397 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:55.754789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:55.763607 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8a50774b-b7f9-48fa-83a5-71db423a4ff2 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1346 microversion: 2.1 time: 0.110942 Aug 24 12:33:55.764191 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 78/154] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:55 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:55.800284 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:55.808486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1a07bdd6-6f1f-4dc6-aba1-8b1f5dad72c6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.260679 Aug 24 12:33:55.809165 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 77/155] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:55 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:56.787448 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:56.788144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:56.796584 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.797248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.797816 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.798711 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.799344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.799862 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.831271 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:56.831952 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:56.842303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.844101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.844250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.845091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:56.845614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:56.846130 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:56.871250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:56.879967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f40d1b30-5137-42aa-9d9d-86fa2d2fe8cb tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1346 microversion: 2.1 time: 0.097830 Aug 24 12:33:56.880533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 79/156] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:56 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:56.982233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:56.991798 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-17d0d0da-1a1b-4fe8-b601-7028fb894039 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.164456 Aug 24 12:33:56.992571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 78/157] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:56 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:57.904742 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:57.905833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:57.916018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:57.916869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:57.917575 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:57.918683 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:57.919423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:57.920110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:57.987198 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:57.996106 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ffc2f334-7781-4691-beb4-5b5928c81830 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1346 microversion: 2.1 time: 0.097855 Aug 24 12:33:57.996685 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 80/158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:57 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:33:58.013553 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:58.014163 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:58.021135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.021623 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.022057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.022752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:58.023207 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:58.023632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:58.171273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:58.183541 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-02202ebf-6fef-4814-bad9-1897228ef6df tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.173540 Aug 24 12:33:58.184448 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 79/159] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:58 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:59.021789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:59.022458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:59.029022 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.029503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.029929 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.030680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.031123 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.031550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.095868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:59.105008 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bc23c7e3-ec84-4e5b-a5b8-598c0f7eb73d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1346 microversion: 2.1 time: 0.086987 Aug 24 12:33:59.105620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 81/160] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:59 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:33:59.209889 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:33:59.210877 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:33:59.220935 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.221416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.221841 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.222519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:33:59.222974 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:33:59.223389 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:33:59.366226 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:33:59.374751 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e0161e1b-5b34-4f16-ad42-a8b4aed86a73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.170958 Aug 24 12:33:59.382877 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 80/161] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:33:59 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:00.141665 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:00.142304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:00.149407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:00.149940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:00.150411 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:00.151160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:00.151650 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:00.152108 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:00.225394 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:00.237001 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7533c68b-d546-4061-b3e1-583b0fcc415d tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1346 microversion: 2.1 time: 0.101185 Aug 24 12:34:00.242933 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 82/162] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:00 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:00.397779 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:00.398774 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:00.405692 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:00.406220 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:00.406656 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:00.407362 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:00.407815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:00.408217 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:00.541673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:00.550342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-47354994-3cbd-4f84-9f69-32f30dcc9847 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.158600 Aug 24 12:34:00.551710 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 81/163] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:00 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:01.260806 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:01.261610 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:01.272026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.272908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.273620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.274747 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.275493 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.276188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.347180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:01.360128 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-50f0efc7-cf74-416a-b997-82f245016b5a tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1346 microversion: 2.1 time: 0.104986 Aug 24 12:34:01.361076 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 83/164] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:01 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:01.576067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:01.576957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:01.584238 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.584753 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.585175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.585860 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:01.586311 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:01.586726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:01.717232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:01.725598 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f2d09a2f-d7f3-495a-a181-5dea1c07d9a1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.156025 Aug 24 12:34:01.726139 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 82/165] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:01 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:02.388503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:02.389282 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:02.396327 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.396858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.397283 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.397979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.398430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.398846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.468731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:02.478567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-204dbe25-73c5-4559-831b-9c018dbde313 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1346 microversion: 2.1 time: 0.095100 Aug 24 12:34:02.479167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 84/166] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:02 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:02.749342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:02.750028 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:02.756798 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.757294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.757796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.758558 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:02.758878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:02.759306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:02.894372 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:02.906169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cbb056f2-ec11-46d1-9fd4-cf33b35dcfee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.162744 Aug 24 12:34:02.906841 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 83/167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:02 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:03.500580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:03.501484 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:03.507921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.508404 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.508859 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.509548 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.509992 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.510406 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.542581 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.543067 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.543567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.544064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lazy-loading 'fault' on Instance uuid 718c8878-059c-4ccf-9928-700abc374250 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:34:03.590745 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1c70920a8a43999c308c8f595b4528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a646ac1b653b49fb80c05ad567f29710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:03.599419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e2208093-3f8c-4b60-a477-6e2b2e93c2bd tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 200 len: 1351 microversion: 2.1 time: 0.103532 Aug 24 12:34:03.600354 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 85/168] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:03 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:03.932173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:03.933490 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:03.945919 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.946746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.947379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:03.948423 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:03.949292 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:03.949910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.128176 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:04.143200 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d22df121-df6f-4f14-a9cb-e1a2960373bd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.218580 Aug 24 12:34:04.143750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 84/169] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:03 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:04.621760 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:04.622359 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:04.629180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.629660 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.630087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.630777 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.631224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.631643 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.646960 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] HTTP exception thrown: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Request method failure captured: Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 HTTP/1.1 Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhpzDq5HOM44NJzlphw86kwVGd_ZXkCQ1b58NM0G30wWzm9F-FQAipeipOxRjsxfzk6fDOqAckrwzvq6voW8QxP-bXG7eMn1ER94idhLa9ob40rN-G9MQn0TwU9zev1JnfrPDmQg7r-GpaoUde-QcPFhiN-WBkPScvrHPP1DwEoYH3U Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: a646ac1b653b49fb80c05ad567f29710 Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:34:04.651741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a646ac1b653b49fb80c05ad567f29710"}]}] Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: a646ac1b653b49fb80c05ad567f29710 Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-DeleteServersTestJSON-1740966832-project Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 8e1c70920a8a43999c308c8f595b4528 Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-DeleteServersTestJSON-1740966832-project Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.653235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '718c8878-059c-4ccf-9928-700abc374250'} Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:34:04.654063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.655458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.656858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Returning 404 to user: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:34:04.656858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c9e0abfb-4a1f-47c7-be78-cbeb570089a0 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 404 len: 111 microversion: 2.1 time: 0.035358 Aug 24 12:34:04.656858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 86/170] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:04 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:34:04.777016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:04.780515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:04.789274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.789803 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.790401 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.791107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:04.791723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:04.792251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:04.806949 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] HTTP exception thrown: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Request method failure captured: Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250/os-volume_attachments HTTP/1.1 Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhpzDq5HOM44NJzlphw86kwVGd_ZXkCQ1b58NM0G30wWzm9F-FQAipeipOxRjsxfzk6fDOqAckrwzvq6voW8QxP-bXG7eMn1ER94idhLa9ob40rN-G9MQn0TwU9zev1JnfrPDmQg7r-GpaoUde-QcPFhiN-WBkPScvrHPP1DwEoYH3U Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: a646ac1b653b49fb80c05ad567f29710 Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:34:04.811219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a646ac1b653b49fb80c05ad567f29710"}]}] Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: a646ac1b653b49fb80c05ad567f29710 Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-DeleteServersTestJSON-1740966832-project Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 8e1c70920a8a43999c308c8f595b4528 Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-DeleteServersTestJSON-1740966832-project Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.813241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'server_id': '718c8878-059c-4ccf-9928-700abc374250'} Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:34:04.814071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:04.815434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:04.816916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Returning 404 to user: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:34:04.816916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c8e2d020-340b-4bb4-b01b-07d17b788a7c tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041920 Aug 24 12:34:04.816916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 85/171] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:34:04 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:34:05.163299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:05.163926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:05.170013 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.170483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.171090 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.171784 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:05.172229 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:05.172660 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:05.334699 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:05.349053 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e78f7ddf-2abb-4942-9efd-c03593b043fd tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.184853 Aug 24 12:34:05.357356 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 87/172] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:05 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:06.028308 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:06.028821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:06.035668 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.036228 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.036868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.037560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.038036 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.038460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.058663 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] HTTP exception thrown: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Request method failure captured: Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 HTTP/1.1 Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhpzDq5HOM44NJzlphw86kwVGd_ZXkCQ1b58NM0G30wWzm9F-FQAipeipOxRjsxfzk6fDOqAckrwzvq6voW8QxP-bXG7eMn1ER94idhLa9ob40rN-G9MQn0TwU9zev1JnfrPDmQg7r-GpaoUde-QcPFhiN-WBkPScvrHPP1DwEoYH3U Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: a646ac1b653b49fb80c05ad567f29710 Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:34:06.063357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a646ac1b653b49fb80c05ad567f29710"}]}] Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: a646ac1b653b49fb80c05ad567f29710 Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-DeleteServersTestJSON-1740966832-project Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 8e1c70920a8a43999c308c8f595b4528 Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-DeleteServersTestJSON-1740966832-project Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.066299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '718c8878-059c-4ccf-9928-700abc374250'} Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:34:06.068342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.070596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.072327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Returning 404 to user: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:34:06.072327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-58306994-e29b-4e2e-9f70-34ba1b01c876 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "DELETE /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 404 len: 111 microversion: 2.1 time: 0.042066 Aug 24 12:34:06.072327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 86/173] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:34:06 2022] DELETE /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:34:06.075706 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:06.076360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] [instance: 718c8878-059c-4ccf-9928-700abc374250] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:06.083712 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.084462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.085161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.086276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.087299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.087799 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.103505 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] HTTP exception thrown: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Request method failure captured: Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 HTTP/1.1 Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhpzDq5HOM44NJzlphw86kwVGd_ZXkCQ1b58NM0G30wWzm9F-FQAipeipOxRjsxfzk6fDOqAckrwzvq6voW8QxP-bXG7eMn1ER94idhLa9ob40rN-G9MQn0TwU9zev1JnfrPDmQg7r-GpaoUde-QcPFhiN-WBkPScvrHPP1DwEoYH3U Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: a646ac1b653b49fb80c05ad567f29710 Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:34:06.105018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a646ac1b653b49fb80c05ad567f29710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a646ac1b653b49fb80c05ad567f29710"}]}] Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: a646ac1b653b49fb80c05ad567f29710 Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-DeleteServersTestJSON-1740966832 Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-DeleteServersTestJSON-1740966832-project Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 8e1c70920a8a43999c308c8f595b4528 Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-DeleteServersTestJSON-1740966832-project Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.106545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '718c8878-059c-4ccf-9928-700abc374250'} Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:34:06.107255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. Aug 24 12:34:06.108533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:06.109921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] Returning 404 to user: Instance 718c8878-059c-4ccf-9928-700abc374250 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:34:06.109921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-409d4c1d-aae4-4554-a678-1236dca44412 tempest-DeleteServersTestJSON-1740966832 tempest-DeleteServersTestJSON-1740966832-project] 10.222.0.27 "GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250" status: 404 len: 111 microversion: 2.1 time: 0.035035 Aug 24 12:34:06.109921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 88/174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:06 2022] GET /compute/v2.1/servers/718c8878-059c-4ccf-9928-700abc374250 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:34:06.366456 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:06.367377 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:06.374906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.375389 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.375879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.376566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:06.391778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:06.392270 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:06.595065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:06.603416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-81e78b97-ef65-42bd-8f7d-41ada88e6b47 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.241338 Aug 24 12:34:06.604327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 87/175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:06 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:07.640125 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:07.640814 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:07.648995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.649739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.650188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.652348 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:07.653078 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:07.654398 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:07.892783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:07.901089 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-4cbdf9e5-f789-4b81-a26c-f55934920744 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.277956 Aug 24 12:34:07.901654 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 89/176] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:07 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:08.923183 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:08.924516 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:08.931058 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:08.931625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:08.932175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:08.933119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:08.933782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:08.934264 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:09.080061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:09.088572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ad0a1949-174e-4d8d-be7f-59abb4cc0ca3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.170179 Aug 24 12:34:09.089426 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 88/177] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:08 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:10.110790 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:10.111418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:10.117608 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:10.118093 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:10.118532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:10.119221 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:10.119673 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:10.120095 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:10.274725 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:10.283588 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-201faa11-2e71-4d48-ada3-4718c70d766b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.176885 Aug 24 12:34:10.284438 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 90/178] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:10 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:11.307320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:11.308188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:11.313146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:11.318516 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:11.319638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:11.320175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:11.321406 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:11.322958 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:11.323611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:11.504531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:11.514164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2ca1b5e8-b79d-4c77-bdf9-d468a22744bc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.210672 Aug 24 12:34:11.515158 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 89/179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:11 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:12.544885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:12.545628 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:12.553244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.554244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.554891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.555844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:12.556422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:12.557130 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:12.788425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:12.802011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ebeb9f0a-775f-499f-97d1-b511a14d8920 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.258718 Aug 24 12:34:12.802656 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 91/180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:12 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:13.824066 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:13.824693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:13.835172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:13.835657 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:13.836119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:13.836953 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:13.837575 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:13.838374 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:14.002703 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:14.013719 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-127dcdd8-d674-460a-9916-d28055bd8a3a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1523 microversion: 2.1 time: 0.193326 Aug 24 12:34:14.014702 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 90/181] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:13 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:15.035598 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:15.037098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:15.044999 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.046412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.047192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:15.048193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.048995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.049722 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:15.266838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:15.273548 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:15.277363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ee5da7e7-3f63-43da-bd91-a9295f6ff70f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1503 microversion: 2.1 time: 0.245542 Aug 24 12:34:15.290211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 92/182] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:15 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:15.297240 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:15.297861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:15.304219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.304957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.305385 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:15.306076 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:15.306518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:15.307097 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:15.510002 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:15.523723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-012cafc3-0875-4961-96e7-7bb54c5ea726 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1516 microversion: 2.1 time: 0.229308 Aug 24 12:34:15.533939 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 91/183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:15 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:16.087561 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-da7822e7-206b-4171-bbae-1c78ee42a158 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'create', calling method: .version_select at 0x7fa677778160>, body: {"keypair": {"name": "tempest-keypair-2024908009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgJSXjUnl6COlL6RRxTWuSYMKdOlm44fnWDWxCNCikdHZJA6s1jf534ou4vkQfcnpjTKUWmb6aL0fNYZvqqMaLhTo41MzmyUVSxj4US3HH0zfBRG7MEglemESVr0xep/A=="}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:16.108592 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-da7822e7-206b-4171-bbae-1c78ee42a158 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Getting quotas for project 9095a2f3c7d946a2b017115364dc6753. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:16.113460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-da7822e7-206b-4171-bbae-1c78ee42a158 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Getting quotas for user fd39206c155f4e1cb9f7f90fb5a10556 and project 9095a2f3c7d946a2b017115364dc6753. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:16.155766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-da7822e7-206b-4171-bbae-1c78ee42a158 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.288006 Aug 24 12:34:16.156371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 93/184] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Aug 24 12:34:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 289 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 12:34:17.223964 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:17.226348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:17.234526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.235105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.235604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.236725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.237287 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.237905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.288546 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lazy-loading 'flavor' on Instance uuid 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:34:17.466879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:17.566415 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a41e18c2-079c-4d3f-9fc3-a5b5a7b04a05 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7/action" status: 200 len: 32 microversion: 2.1 time: 0.354455 Aug 24 12:34:17.567201 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 92/185] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:17 2022] POST /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7/action => generated 32 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:34:17.577370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:17.578575 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:17.581216 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:17.608915 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.611810 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.613169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.619389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:17.620112 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:17.621216 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:17.954294 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:17.965127 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-580ef395-fb4c-40cd-b472-0e9c525e676b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.392389 Aug 24 12:34:17.971390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 94/186] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:17 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:18.120298 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1653419262", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d6c857e-b67a-49a9-87ca-af5b474759f7"}], "security_groups": [{"name": "tempest-securitygroup--286686463"}], "key_name": "tempest-keypair-2024908009", "user_data": "}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:18.304235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] validate_networks() for [('4d6c857e-b67a-49a9-87ca-af5b474759f7', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:34:18.899273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:34:18.899887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:34:18.900731 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:34:18.901287 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:34:18.902207 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:34:18.914501 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:18.915730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:18.916634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:18.917706 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:18.918520 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:18.919101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:18.941788 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Getting quotas for project 9095a2f3c7d946a2b017115364dc6753. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:18.946143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Getting quotas for user fd39206c155f4e1cb9f7f90fb5a10556 and project 9095a2f3c7d946a2b017115364dc6753. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:18.958730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:34:18.961305 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:34:18.988057 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:18.988690 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:18.996137 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:19.000531 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:19.001369 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:19.003992 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:19.004811 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:19.006171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:19.021974 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-78c8249d-1d5a-431b-9cc3-ce5478695f7c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.906858 Aug 24 12:34:19.022976 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 93/187] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Aug 24 12:34:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 12:34:19.037779 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-77e1668f-d964-4369-add6-b9bd32c0f9ea tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:19.038665 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-77e1668f-d964-4369-add6-b9bd32c0f9ea tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:19.193295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-77e1668f-d964-4369-add6-b9bd32c0f9ea tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:19.205067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-77e1668f-d964-4369-add6-b9bd32c0f9ea tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:19.212592 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-77e1668f-d964-4369-add6-b9bd32c0f9ea tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:19.214302 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-77e1668f-d964-4369-add6-b9bd32c0f9ea tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1282 microversion: 2.20 time: 0.184798 Aug 24 12:34:19.218845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 94/188] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:19 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:19.332867 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:19.344891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2ff76c7b-e3fa-492c-8df6-27d2ee7b3da7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.358867 Aug 24 12:34:19.345528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 95/189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:18 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:20.238268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:20.244602 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:20.263492 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:20.264129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:20.264848 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:20.265582 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:20.266273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:20.266855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:20.365742 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:20.366343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:20.372926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:20.373655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:20.374071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:20.374797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:20.375314 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:20.375731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:20.383422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:20.402809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:20.404741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:20.406130 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1ad95ab1-81ec-4d1e-a832-8fd60875b93d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1334 microversion: 2.20 time: 0.172113 Aug 24 12:34:20.406666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 95/190] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:20 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1334 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:20.608158 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:20.626828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3b4f2baf-2e17-4565-b493-4f562ce07bf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.264936 Aug 24 12:34:20.627515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 96/191] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:20 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:21.442304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:21.443137 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:21.451182 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.451819 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.452217 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.453144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.453599 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.454000 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.558640 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:21.582550 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:21.585831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:21.587566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-95dc50ea-19bf-4913-b83f-bf0c34a7104b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1340 microversion: 2.20 time: 0.149423 Aug 24 12:34:21.594051 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 96/192] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:21 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1340 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:21.651938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:21.653442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:21.660692 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.661497 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.662122 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.663039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:21.663630 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:21.664300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:21.869748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:21.882051 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-82f7e1de-2417-4d6b-a1e9-2b23c78a7cf9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.237722 Aug 24 12:34:21.895507 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 97/193] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:21 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:22.619872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:22.620572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:22.627931 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:22.628503 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:22.629035 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:22.629802 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:22.630390 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:22.630871 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:22.880333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:22.896778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:22.899771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:22.901888 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-44e7e920-4c72-44db-9ea9-b04a9f5953fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1407 microversion: 2.20 time: 0.294266 Aug 24 12:34:22.911153 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:22.915143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 97/194] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:22 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:22.915702 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:22.928904 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:22.930164 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:22.931976 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:22.934831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:22.936593 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:22.938102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:23.160018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:23.177054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ad22749b-e053-44d8-ad52-e1f0af138e73 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.275324 Aug 24 12:34:23.177638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 98/195] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:22 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:23.201836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-3d8b2d69-caa2-4913-b7b4-37bbaaad6e1c req-d9387e71-3da9-4ef1-a75d-cf7dcbeb62a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac6a7ad-e418-48a8-8e4b-a1449c35183a", "tag": "2846875a-a14c-495e-a9aa-ea984a5071c2"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:23.216069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-3d8b2d69-caa2-4913-b7b4-37bbaaad6e1c req-d9387e71-3da9-4ef1-a75d-cf7dcbeb62a8 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.216555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-3d8b2d69-caa2-4913-b7b4-37bbaaad6e1c req-d9387e71-3da9-4ef1-a75d-cf7dcbeb62a8 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.217193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-3d8b2d69-caa2-4913-b7b4-37bbaaad6e1c req-d9387e71-3da9-4ef1-a75d-cf7dcbeb62a8 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:23.230620 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-3d8b2d69-caa2-4913-b7b4-37bbaaad6e1c req-d9387e71-3da9-4ef1-a75d-cf7dcbeb62a8 service nova] Creating event network-changed:2846875a-a14c-495e-a9aa-ea984a5071c2 for instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a on hv-cinder-84605 Aug 24 12:34:23.238538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-3d8b2d69-caa2-4913-b7b4-37bbaaad6e1c req-d9387e71-3da9-4ef1-a75d-cf7dcbeb62a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041984 Aug 24 12:34:23.239686 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 98/196] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:23.941972 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:23.942777 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:23.949284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.949769 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.950201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:23.950888 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:23.951868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:23.952477 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:24.103523 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:24.112336 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:24.113916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:24.115007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-38d3c447-84ba-4488-85d4-a48fd9f93b8c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1407 microversion: 2.20 time: 0.176997 Aug 24 12:34:24.115554 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 99/197] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:23 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:24.198503 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:24.199309 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:24.206674 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:24.207137 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:24.207564 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:24.209157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:24.209671 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:24.210087 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:24.343192 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:24.351419 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e63e4bd1-dc2d-420a-9e04-00e2bf17a010 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.157030 Aug 24 12:34:24.351918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 99/198] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:24 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:25.137252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:25.137847 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:25.147246 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:25.147730 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:25.148168 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.148887 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:25.149380 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:25.149804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.372348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:25.373755 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:25.382369 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.383252 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:25.383774 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:25.384222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.385125 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:25.385580 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:25.386528 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:25.392007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.393516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.395062 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7daeb736-8a7e-4a09-9969-b3bda56e9238 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1407 microversion: 2.20 time: 0.262025 Aug 24 12:34:25.395641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 100/199] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:25 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:25.581693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:25.589709 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-abb5594a-797a-40a2-aa9e-b7c3aa8ba10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.221304 Aug 24 12:34:25.590473 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 100/200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:25 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:26.421270 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:26.421883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:26.423729 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=4 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:26.429134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.429585 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.430020 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.430763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.431167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.431904 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.568793 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.578425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.579967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.581109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1eeea61b-b720-45e0-8cc6-b57578a450df tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1407 microversion: 2.20 time: 0.165782 Aug 24 12:34:26.581803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 101/201] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:26 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:26.610811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:26.611387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:26.617876 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.618350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.618963 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.619652 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:26.620100 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:26.620511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:26.899243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:26.908749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-939b9be8-df30-44ee-a8cc-241d61143335 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.301895 Aug 24 12:34:26.909631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 101/202] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:26 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:27.602968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:27.603546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:27.610094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.610578 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.611008 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.611734 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.612352 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.612582 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.749717 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:27.758191 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:27.759684 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:27.760858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-33ba51f1-f4ee-4112-9bba-e20e02784fb4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1407 microversion: 2.20 time: 0.161701 Aug 24 12:34:27.761440 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 102/203] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:27 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:27.934775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:27.935752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:27.946187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.946746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.947428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:27.948194 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:27.948669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:27.949353 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.090842 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.099478 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-157077a3-6a35-40d4-9682-ccbbf363c900 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.170830 Aug 24 12:34:28.100062 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 102/204] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:27 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:28.133554 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-c79e079d-8ceb-494e-9ea7-5357eccd7906 req-33a10899-36d3-41af-b2f5-039de5e2fa57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac6a7ad-e418-48a8-8e4b-a1449c35183a", "name": "network-vif-plugged", "status": "completed", "tag": "2846875a-a14c-495e-a9aa-ea984a5071c2"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:28.147203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-c79e079d-8ceb-494e-9ea7-5357eccd7906 req-33a10899-36d3-41af-b2f5-039de5e2fa57 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.147866 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-c79e079d-8ceb-494e-9ea7-5357eccd7906 req-33a10899-36d3-41af-b2f5-039de5e2fa57 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.148294 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-c79e079d-8ceb-494e-9ea7-5357eccd7906 req-33a10899-36d3-41af-b2f5-039de5e2fa57 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.160134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-c79e079d-8ceb-494e-9ea7-5357eccd7906 req-33a10899-36d3-41af-b2f5-039de5e2fa57 service nova] Creating event network-vif-plugged:2846875a-a14c-495e-a9aa-ea984a5071c2 for instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a on hv-cinder-84605 Aug 24 12:34:28.165109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-c79e079d-8ceb-494e-9ea7-5357eccd7906 req-33a10899-36d3-41af-b2f5-039de5e2fa57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035694 Aug 24 12:34:28.165661 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 103/205] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:28.784110 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:28.784682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:28.791419 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.791912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.792339 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.793078 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:28.793534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:28.793954 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:28.930991 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.934637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:28.943502 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.945053 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:28.946154 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a3628d2b-ec58-41c8-8732-f3c3e3d178d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1407 microversion: 2.20 time: 0.166182 Aug 24 12:34:28.946703 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 103/206] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:28 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:29.125983 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:29.126679 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:29.134171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.134653 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.135086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.135780 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.136297 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.137088 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.285517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:29.293501 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-360f4216-8749-4350-8d7b-8c25feef2aea tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.173901 Aug 24 12:34:29.294031 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 104/207] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:29 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:29.968991 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:29.969549 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:29.971378 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=8 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:29.977492 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.977980 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.978411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:29.984177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:29.984177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:29.984177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.135097 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.144274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.145894 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.147049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-30e13f47-7eb8-4ab4-8d3d-1fbc63d2c784 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1407 microversion: 2.20 time: 0.182257 Aug 24 12:34:30.147622 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 104/208] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:29 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:34:30.314800 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:30.315416 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:30.321785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.322288 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.322728 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.323432 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.323905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.324339 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.482705 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:30.490851 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-af382e35-0a66-446d-828d-3c5a3303d986 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.180293 Aug 24 12:34:30.491641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 105/209] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:30 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:30.664324 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:30.664927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:30.671352 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.671840 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.672285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.673009 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:30.673484 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:30.673906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:30.698372 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6a86e092-efff-4575-9b67-ed25144691b8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/ips" status: 200 len: 147 microversion: 2.1 time: 0.037920 Aug 24 12:34:30.698948 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 105/210] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:34:30 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:31.175379 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:31.176138 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:31.182265 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.182797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.183220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.183898 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.184343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.184779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.317285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.325740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.327347 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.328487 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-18a470c2-9403-41ef-a512-fb1b62334c15 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1598 microversion: 2.20 time: 0.157285 Aug 24 12:34:31.329094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 106/211] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:34:31 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:34:31.351257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:31.351824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:31.358729 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.359210 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.359640 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.360313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.360819 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.361241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.454415 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-017a843b-d0d0-423a-9a49-ff9c92a6b87d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107016 Aug 24 12:34:31.454988 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 106/212] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Aug 24 12:34:31 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:34:31.514656 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:31.515255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:31.521485 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.521988 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.522413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.523092 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:31.523537 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:31.523945 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:31.792926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:31.801233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9bef1bab-09b2-48b1-8402-6b2a07bf92a3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.292427 Aug 24 12:34:31.801798 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 107/213] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:31 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:32.771365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-b5f7a2df-5f6c-4acd-85dc-e48cc54ea88e req-9dbaef25-c1ef-480d-904d-66a6fd026e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac6a7ad-e418-48a8-8e4b-a1449c35183a", "tag": "2846875a-a14c-495e-a9aa-ea984a5071c2"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:32.781841 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b5f7a2df-5f6c-4acd-85dc-e48cc54ea88e req-9dbaef25-c1ef-480d-904d-66a6fd026e1a service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.782320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b5f7a2df-5f6c-4acd-85dc-e48cc54ea88e req-9dbaef25-c1ef-480d-904d-66a6fd026e1a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.782721 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b5f7a2df-5f6c-4acd-85dc-e48cc54ea88e req-9dbaef25-c1ef-480d-904d-66a6fd026e1a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.794867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-b5f7a2df-5f6c-4acd-85dc-e48cc54ea88e req-9dbaef25-c1ef-480d-904d-66a6fd026e1a service nova] Creating event network-changed:2846875a-a14c-495e-a9aa-ea984a5071c2 for instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a on hv-cinder-84605 Aug 24 12:34:32.800258 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-b5f7a2df-5f6c-4acd-85dc-e48cc54ea88e req-9dbaef25-c1ef-480d-904d-66a6fd026e1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032935 Aug 24 12:34:32.800880 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 107/214] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:32.823359 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:32.823962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:32.830472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.830962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.831393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:32.832120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:32.832574 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:32.833089 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:33.067650 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:33.078694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c785a7ab-f7d5-4c83-b20a-f700b54d82cf tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.259120 Aug 24 12:34:33.079494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 108/215] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:32 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:34.100116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:34.100954 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:34.107511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:34.108164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:34.108604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:34.109307 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:34.109759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:34.110180 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:34.259750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:34.267661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-661bd27e-394f-4efe-ae05-92f28f5e1803 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.171804 Aug 24 12:34:34.268243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 108/216] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:34 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:35.163015 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df45523f-4950-43ae-82d2-0cbba458e72b"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:35.165338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:35.171892 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.172363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.172823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.173495 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.173949 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.174349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.293062 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:35.293625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:35.301209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.301697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.302134 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.302831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.303291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.303787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.451570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:35.459368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-badf2589-9154-470f-a4c5-fddc02e1b25d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.170598 Aug 24 12:34:35.460242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 109/217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:35 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:35.464782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:35.465304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:35.471625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.472118 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.472556 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.473313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:35.473797 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:35.474199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:35.494443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:35.503340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5a7c1cef-f504-4b59-836d-458124aa32c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/ips" status: 200 len: 149 microversion: 2.1 time: 0.041943 Aug 24 12:34:35.504119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 110/218] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:34:35 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:35.512764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1db42464-8540-420c-80e4-f75c0b8866a7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353870 Aug 24 12:34:35.514056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 109/219] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:34:35 2022] POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:36.482807 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:36.483435 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:36.490173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.490651 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.491072 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.491744 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.492188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.492635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.628882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:36.636688 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-226197f3-4ecf-4db8-ae14-7648408234b9 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.157846 Aug 24 12:34:36.637245 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 111/220] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:36 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:36.925724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff155a9-a517-4c4e-9863-d537b84f522b"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:36.928402 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:36.938054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.938558 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.938953 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:36.939844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:36.940292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:36.940756 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.240237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b921de0b-c7f2-4ff9-bfc0-bd44be0a5516 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318487 Aug 24 12:34:37.240876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 110/221] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:34:36 2022] POST /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:37.662139 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:37.663459 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:37.674843 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.675329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.675753 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.677025 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:37.677497 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:37.677901 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:37.682833 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:37.839779 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:37.849898 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8f1ff4a9-8480-49da-a9ca-8982e80c7b14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.192275 Aug 24 12:34:37.850563 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 112/222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:37 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:38.872943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:38.873765 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:38.881214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.881722 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.882294 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:38.882988 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:38.883452 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:38.883855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:39.059877 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:39.071716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-94aebc6f-d3fe-4759-9331-f13141a6e043 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.204286 Aug 24 12:34:39.072965 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 111/223] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:38 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:40.094857 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:40.095424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:40.101815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.102475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.103116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.103829 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:40.104289 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:40.104732 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:40.366444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:40.374696 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-937aaae2-78ec-42f0-80bb-9d0fb4ae3c9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.284398 Aug 24 12:34:40.375084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 113/224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:40 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:41.399460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:41.401356 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:41.410921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.411774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.412443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.413587 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:41.414285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:41.414924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:41.808166 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:41.818366 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-07568053-d011-48e0-8441-cdf65989cf53 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.426976 Aug 24 12:34:41.819022 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 112/225] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:41 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:42.845275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:42.846620 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:42.854548 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:42.859845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.860498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.861138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:42.861966 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:42.863101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:42.863790 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.073608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.082125 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-780869e7-0f23-4483-b266-1bf863c786eb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1502 microversion: 2.1 time: 0.245053 Aug 24 12:34:43.083087 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 114/226] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:42 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:43.102880 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e593ffb-353d-40df-937d-8bb10f4199c5"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:43.105872 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:43.113336 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.113824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.114254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.114953 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.115394 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.115791 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.140537 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] HTTP exception thrown: Cannot 'attach_volume' instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 while it is in vm_state rescued Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Request method failure captured: Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: POST /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7/os-volume_attachments HTTP/1.1 Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 74 Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp5kFLOwMoQfDuoqV9OaiK27E3R7iCj1fFESiH9PZCFXQFTab8fK-2w8Bs8_TMr_SLLsSiPZ4ZwQW6ZNcR_qqKoizjITLf3aHbmVnciBlzkKvnBeBZAqhV0hF3FMuMygkwYRZece1uvcRkCz7ssTDpdPE-epN1q1H3jWavzuwztb7I Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:34:43.142634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}] Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: e34cbcf69b4b4828a3bca077fc8d0694 Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {"volumeAttachment": {"volumeId": "1e593ffb-353d-40df-937d-8bb10f4199c5"}} Aug 24 12:34:43.144183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Cannot 'attach_volume' instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 while it is in vm_state rescued Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'server_id': '336ccc96-8289-4d8f-a2e0-6ee9d99345d7', 'body': {'volumeAttachment': {'volumeId': '1e593ffb-353d-40df-937d-8bb10f4199c5'}}} Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:34:43.145192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 while it is in vm_state rescued Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:34:43.146428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:34:43.147471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:34:43.147471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:34:43.147471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 while it is in vm_state rescued Aug 24 12:34:43.147471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:34:43.147471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Returning 409 to user: Cannot 'attach_volume' instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 while it is in vm_state rescued {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:34:43.147471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-48c0edcf-be5d-4062-8889-caa2a9a04696 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045321 Aug 24 12:34:43.147471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 113/227] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:34:43 2022] POST /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:34:43.154906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:43.155444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:43.161717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.162206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.162637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.163340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.163789 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.164209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.250823 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-917ddfec-7364-4215-ba14-6125fe66fc17 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7/action" status: 202 len: 0 microversion: 2.1 time: 0.100343 Aug 24 12:34:43.251750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 115/228] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:43 2022] POST /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:34:43.264787 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:43.265406 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:43.275704 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.277767 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.280394 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.282799 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:43.283649 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:43.285150 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:43.582783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:43.592293 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-761ff77a-4837-43c1-9b47-ef1a0202dc1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1510 microversion: 2.1 time: 0.332910 Aug 24 12:34:43.594155 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 114/229] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:43 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:44.207059 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-84b7c1ac-31e7-474e-b9f4-b8ad9b417bac tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:44.215507 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84b7c1ac-31e7-474e-b9f4-b8ad9b417bac tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.216480 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84b7c1ac-31e7-474e-b9f4-b8ad9b417bac tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.217101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84b7c1ac-31e7-474e-b9f4-b8ad9b417bac tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.280834 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-84b7c1ac-31e7-474e-b9f4-b8ad9b417bac tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Going to try to stop instance {{(pid=127298) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 12:34:44.338888 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-84b7c1ac-31e7-474e-b9f4-b8ad9b417bac tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.134285 Aug 24 12:34:44.339744 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 116/230] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:34:44 2022] POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:34:44.348406 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:44.348941 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:44.356011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.357020 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.357583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.358429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.359856 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.360433 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.543711 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:44.552522 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9183ffaf-e7ab-41b5-bcd6-72aac2cb163d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.208231 Aug 24 12:34:44.553175 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 115/231] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:44 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:44.618208 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:44.619154 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:44.625955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.626818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.627596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.629007 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:44.629538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:44.630085 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:44.910813 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:44.920336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-660e7e47-49a5-4638-85f6-76ee76b6de14 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1510 microversion: 2.1 time: 0.306984 Aug 24 12:34:44.921559 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 117/232] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:44 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1510 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:45.575795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:45.577250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:45.599077 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.600245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.603079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.606942 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.610390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.612181 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.942957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:45.943404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:45.958047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.959257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.959788 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:45.960594 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:45.961205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:45.961720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:46.107243 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.123395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-63bcadcb-9d55-4185-b0f7-ef972aedfb59 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.552220 Aug 24 12:34:46.124348 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 116/233] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:45 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:46.303199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:46.312318 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0fb90cc0-53f9-400a-9725-6e8d672330fe tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1510 microversion: 2.1 time: 0.374284 Aug 24 12:34:46.313435 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 118/234] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:45 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:47.146617 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:47.147979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:47.156201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.156864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.157431 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.158232 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.158819 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.159321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.334732 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:47.335360 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:47.346302 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.346805 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.352778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.357223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.365815 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d20362ad-bc69-48e1-8397-b50afbf2b387 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.223089 Aug 24 12:34:47.367057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:47.367864 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:47.368952 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:47.372104 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 117/235] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:47 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:47.545338 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:47.557500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6547b557-82d1-4c14-b18b-aa32523c5d2d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1516 microversion: 2.1 time: 0.227401 Aug 24 12:34:47.573274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 119/236] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:47 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1516 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:48.392004 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:48.393167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:48.395882 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=48 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:48.402763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.403520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.403949 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.404844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:48.405472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:48.406037 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:48.563431 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:48.571970 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d3a7671a-8ef0-4d81-a8ac-a1fbeda23396 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.183912 Aug 24 12:34:48.572540 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 118/237] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:48 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:49.594778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:49.595489 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:49.602385 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.603019 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.603522 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.604474 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:49.605750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:49.606501 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:49.755970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:49.765219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-348fa1e2-4336-4975-bfa1-c2837c9ddcae tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.174739 Aug 24 12:34:49.766127 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 120/238] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:49 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:50.852385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:50.853781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:50.860949 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.861567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.862243 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:50.863113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:50.863566 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:50.863996 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:51.125453 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f534b628-750e-456e-a1d5-d1c3934132f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'create', calling method: .version_select at 0x7fa676eda9d0>, body: {"keypair": {"name": "tempest-keypair-749837459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeuTvaeqBDOEyQW/dLEk9LLNxzII+2PAX1Zu7yQN97I7yUV/qXUEnIcyCewDYJWLgiNNFXz6AvsTnNMvRPeVOxTKb5EetMJDnJ8b/IxJmzOyWuZekuedQ23/qxiG35uzw=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:51.143394 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-f534b628-750e-456e-a1d5-d1c3934132f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Getting quotas for project 3276a7bc6bb84ac7953d2d46c4298a23. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:51.145190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:51.150190 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-f534b628-750e-456e-a1d5-d1c3934132f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Getting quotas for user e34cbcf69b4b4828a3bca077fc8d0694 and project 3276a7bc6bb84ac7953d2d46c4298a23. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:51.155937 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-840e7cae-f50b-4164-bad4-3b0ffc96ba43 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.372866 Aug 24 12:34:51.158719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 119/239] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:50 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:51.177969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f534b628-750e-456e-a1d5-d1c3934132f8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057917 Aug 24 12:34:51.179400 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 121/240] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:34:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:34:52.177689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:52.178283 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:52.189635 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.191968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.192895 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.195269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:52.195903 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:52.197024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:52.597786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:52.612413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b69646d0-cd30-45a7-adf8-73a32cdc466b tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.438303 Aug 24 12:34:52.613409 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 120/241] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:52 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:53.462705 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-222465745", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b00813ec-943f-4d2b-8732-2fdea8f78407"}], "security_groups": [{"name": "tempest-securitygroup--1851535968"}], "key_name": "tempest-keypair-749837459", "user_data": "}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:53.636891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:53.637749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:53.648942 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.651457 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.652005 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.655232 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:53.655866 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:53.656393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:53.698274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] validate_networks() for [('b00813ec-943f-4d2b-8732-2fdea8f78407', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:34:53.940006 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:53.959151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b5f1c4ed-edda-4bc3-8f56-da796fef586f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.326721 Aug 24 12:34:53.968706 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 121/242] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:53 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:54.280628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:34:54.281147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:34:54.281682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:34:54.282169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:34:54.282643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:34:54.291786 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.292580 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.293287 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.294281 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.295030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.298948 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:54.317921 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Getting quotas for project 3276a7bc6bb84ac7953d2d46c4298a23. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:54.322077 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Getting quotas for user e34cbcf69b4b4828a3bca077fc8d0694 and project 3276a7bc6bb84ac7953d2d46c4298a23. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:54.335867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:34:54.338553 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:34:54.400404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-86ee10ef-d17e-49ba-8679-59b79d4356ca tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.942443 Aug 24 12:34:54.407716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 122/243] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:34:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:34:54.413117 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-28c595c7-fce5-4c88-ae87-aada131813e3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:54.413919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-28c595c7-fce5-4c88-ae87-aada131813e3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:54.480104 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-28c595c7-fce5-4c88-ae87-aada131813e3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:54.489504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-28c595c7-fce5-4c88-ae87-aada131813e3 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1244 microversion: 2.1 time: 0.080579 Aug 24 12:34:54.491257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 122/244] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:54 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:34:54.990380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:54.991746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:54.998386 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:54.998872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:54.999304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.000010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.000465 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.000914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.166168 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:55.177062 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c09c6189-4d95-40b4-9d64-1cadd4776ea6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.190840 Aug 24 12:34:55.191238 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 123/245] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:54 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:55.510776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:55.511392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:55.518781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.519266 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.519897 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.520603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:55.521098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:55.521502 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:55.593185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:55.604879 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-729d7e3a-34c1-4cc6-8a7c-b21d52b09df1 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1248 microversion: 2.1 time: 0.098639 Aug 24 12:34:55.605601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 123/246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:55 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1248 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:56.199658 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:56.201069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:56.209695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.213268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.214048 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.214977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.215798 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.216494 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.389129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.398895 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0593a877-c0b1-47f2-8ba3-99f31f1ad187 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.202962 Aug 24 12:34:56.400174 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 124/247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:56 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:56.638753 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:56.639474 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:56.652956 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.653867 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.654490 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.655635 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:56.656476 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:56.657091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:56.743628 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:56.759503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5584fcc5-dc77-4505-b951-3f263c4e39b8 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1248 microversion: 2.1 time: 0.135561 Aug 24 12:34:56.760088 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 124/248] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:56 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1248 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:57.421495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:57.422135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:57.430851 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.431302 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.431743 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.432504 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.432977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.433403 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.581625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.591622 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-002d0337-a28c-4d37-abd1-65408d441e44 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.174170 Aug 24 12:34:57.592523 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 125/249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:57 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:57.782449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:57.783609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:57.791862 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.792686 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.793348 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.794224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:57.795479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:57.796054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:57.868632 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:57.878454 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-84d1d9d4-324b-4a74-b75f-3bf6d635455d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1240 microversion: 2.1 time: 0.099647 Aug 24 12:34:57.894075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 125/250] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:57 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1240 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:58.616319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:58.620352 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:58.627955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.628450 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.628924 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.629884 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.630361 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.630958 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.878003 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:58.887515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c6d3bcbc-20fa-4860-a550-59ca483d30d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.275414 Aug 24 12:34:58.891400 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 126/251] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:58 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:58.909064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:58.910384 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:58.920695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.922468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.923112 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.923841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:58.924302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:58.928793 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:58.962160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:34:59.034923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:34:59.051933 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-eba37e25-dbe3-44c2-b6ef-7ef2375f8129 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1302 microversion: 2.1 time: 0.148262 Aug 24 12:34:59.053907 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 126/252] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:58 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1302 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:34:59.137859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-800ba175-dc30-4153-aa9c-fbabe9112be8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: .version_select at 0x7fa67c181430>, body: {"keypair": {"name": "tempest-keypair-54204028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1uWAFmV3IWR0OGM/nAUISCkkOB52kpQvlGLAIx6J2/xsjfjpzg7pEkAvtmNiisNrwU3HFxcXloOEvB0Q1lgj7QeojOnnZ9L1ihmyHwRz7Cg2waEpzOHjmJfdtC4cvtFA=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:34:59.155250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-800ba175-dc30-4153-aa9c-fbabe9112be8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for project 75590a43f50b48699fc0d5a892a99544. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:34:59.159681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-800ba175-dc30-4153-aa9c-fbabe9112be8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for user b4a617fc13534a89ad50a5fdc7bf769a and project 75590a43f50b48699fc0d5a892a99544. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:34:59.187748 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-800ba175-dc30-4153-aa9c-fbabe9112be8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.054401 Aug 24 12:34:59.189032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 127/253] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:34:59 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:34:59.913926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:34:59.915206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:34:59.922890 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.923686 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.924279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:34:59.925172 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:34:59.925822 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:34:59.926410 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.079974 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:00.082001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:00.090383 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.091198 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.091467 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.096095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:00.097177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:00.097772 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:00.814984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:00.816522 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:00.828317 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f29a8a7a-55ed-4e89-b45d-cad628904b73 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.918758 Aug 24 12:35:00.829219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 127/254] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:34:59 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:00.831978 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9e9afd63-6b60-45c1-be99-ac1fef1f5272 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.760686 Aug 24 12:35:00.832972 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 128/255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:00 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:00.848723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-27dc525a-8381-4da3-b5c0-e14541ea8f09 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Action: 'create', calling method: .version_select at 0x7fa676e425e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-534366296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN47iHfdgiKGrncyxU0mzhO7xQVuRV+fbq6vdQy/bX5mZBuYNUu8ksSULIt8iNkpDs56/9MGdMwdqt2611YKGdc3/J8bifGfAUr5mUbBMSJbjhbq3e2Ae1wEyQj4eTR7PA=="}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:00.865261 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-27dc525a-8381-4da3-b5c0-e14541ea8f09 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Getting quotas for project 5dc78d8e41d843a2b085f8300a285a0e. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:35:00.869622 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-27dc525a-8381-4da3-b5c0-e14541ea8f09 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Getting quotas for user 3a145fea1ee64ab18b93f3bf47c3fb65 and project 5dc78d8e41d843a2b085f8300a285a0e. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:35:00.894443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-27dc525a-8381-4da3-b5c0-e14541ea8f09 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062915 Aug 24 12:35:00.895208 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 128/256] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:35:00 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:00.955266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-881624753", "imageRef": "2bc8ad5b-10d3-4c22-b5a4-017195873e63", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-534366296", "networks": [{"uuid": "c045dc1a-695f-419e-a77e-83b864d2ff6e"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:01.014486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] validate_networks() for [('c045dc1a-695f-419e-a77e-83b864d2ff6e', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:35:01.216015 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-843749297", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bd462f6-55a5-43db-8eee-5cc12a9f44b1"}], "security_groups": [{"name": "tempest-securitygroup--621022814"}], "key_name": "tempest-keypair-54204028", "user_data": "}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:01.413435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] validate_networks() for [('3bd462f6-55a5-43db-8eee-5cc12a9f44b1', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:35:01.819366 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:35:01.819879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:35:01.820360 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:35:01.820879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:35:01.821357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:35:01.830641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.831146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.831549 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.832461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.833094 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.833685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.852381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Getting quotas for project 5dc78d8e41d843a2b085f8300a285a0e. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:35:01.856588 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Getting quotas for user 3a145fea1ee64ab18b93f3bf47c3fb65 and project 5dc78d8e41d843a2b085f8300a285a0e. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:35:01.869685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:35:01.871912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2bc8ad5b-10d3-4c22-b5a4-017195873e63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:35:01.926799 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dd524a35-53cc-4ca4-acad-4659be9e4169 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977446 Aug 24 12:35:01.927839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 129/257] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:35:01.933477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-d2db4133-63dd-4f49-b59b-105174ee23c9 req-78a7d1cc-1a15-44db-8bd4-5b9a6ddce99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92266f2b-5066-4d2e-b0a0-49f3ac0e3510", "tag": "8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:01.946680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d2db4133-63dd-4f49-b59b-105174ee23c9 req-78a7d1cc-1a15-44db-8bd4-5b9a6ddce99b service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.947093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d2db4133-63dd-4f49-b59b-105174ee23c9 req-78a7d1cc-1a15-44db-8bd4-5b9a6ddce99b service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.947559 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d2db4133-63dd-4f49-b59b-105174ee23c9 req-78a7d1cc-1a15-44db-8bd4-5b9a6ddce99b service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.952257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:01.960896 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-d2db4133-63dd-4f49-b59b-105174ee23c9 req-78a7d1cc-1a15-44db-8bd4-5b9a6ddce99b service nova] Creating event network-changed:8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b for instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 on hv-cinder-84605 Aug 24 12:35:01.966329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-d2db4133-63dd-4f49-b59b-105174ee23c9 req-78a7d1cc-1a15-44db-8bd4-5b9a6ddce99b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036958 Aug 24 12:35:01.967655 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 130/258] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:01.972963 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:01.973657 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:01.983170 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.983726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.984379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:01.985399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:01.985861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:01.986323 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.262490 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.264700 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:35:02.265650 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:35:02.266118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:35:02.266525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:35:02.267095 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:35:02.271070 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3c426e1f-2760-4d37-aa22-08d2462c0bd2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.302260 Aug 24 12:35:02.271659 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 131/259] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:01 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:02.278342 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.279053 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.279887 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.280796 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.281414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.282003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.289520 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.290129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:02.296494 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.297251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.297685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.298570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.299024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.299447 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.304437 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for project 75590a43f50b48699fc0d5a892a99544. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:35:02.310237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for user b4a617fc13534a89ad50a5fdc7bf769a and project 75590a43f50b48699fc0d5a892a99544. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:35:02.328958 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:35:02.333516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:35:02.405220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-38da5cbc-e886-4b07-b495-b110684fb768 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.194463 Aug 24 12:35:02.406213 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 129/260] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:35:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:35:02.412210 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.413829 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:02.428007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.428887 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.429612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.431494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:02.432263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:02.432981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:02.553528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.561700 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.562395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a4f84625-8233-4a33-8df7-463c466634da tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1261 microversion: 2.1 time: 0.154874 Aug 24 12:35:02.562969 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 130/261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:02.567726 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2cff357d-c7a6-42ff-b5a6-57d4aebbde77 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:02.568569 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2cff357d-c7a6-42ff-b5a6-57d4aebbde77 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:02.571657 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4947f7a8-0edd-4f69-b07d-d51d57119112 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.285852 Aug 24 12:35:02.578748 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 132/262] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:02.659781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2cff357d-c7a6-42ff-b5a6-57d4aebbde77 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:02.679244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2cff357d-c7a6-42ff-b5a6-57d4aebbde77 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1239 microversion: 2.1 time: 0.114422 Aug 24 12:35:02.681063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 131/263] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:02 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1239 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:03.291470 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.292105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.299519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.300003 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.300413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.301172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.301693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.302040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.445715 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:03.454624 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0adca9e7-4a72-457c-9840-10fa763ae3b2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1702 microversion: 2.1 time: 0.167040 Aug 24 12:35:03.455217 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 133/264] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1702 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:03.475413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-158ff34f-8b4f-4429-bcb1-316b2729ceb8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:03.483240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-158ff34f-8b4f-4429-bcb1-316b2729ceb8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.483723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-158ff34f-8b4f-4429-bcb1-316b2729ceb8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.484158 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-158ff34f-8b4f-4429-bcb1-316b2729ceb8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.546016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-158ff34f-8b4f-4429-bcb1-316b2729ceb8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Going to try to start instance {{(pid=127299) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 12:35:03.582926 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.583884 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.590351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.590940 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.591442 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.592198 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.592852 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.593281 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.593453 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-158ff34f-8b4f-4429-bcb1-316b2729ceb8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.121648 Aug 24 12:35:03.598810 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 132/265] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:35:03 2022] POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:35:03.605666 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.606413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.614058 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.614610 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.615039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.615730 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.616180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.616597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.663053 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:03.672821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f0762ce0-677b-4c25-9425-e941a7b9266b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1309 microversion: 2.1 time: 0.093242 Aug 24 12:35:03.673868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 134/266] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:03.684570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.685873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.693631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.694242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.695282 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.695537 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.696001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.696428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.807313 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:03.818261 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a37146c9-af05-4faf-92c7-fb255a1c8552 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.216873 Aug 24 12:35:03.819147 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 133/267] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:03.824549 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:03.825264 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:03.831562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.832716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.833349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.834200 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:03.834794 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:03.835355 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:03.854605 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:03.865350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8ac85f37-dfe7-48eb-b649-38da40fae55d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.186241 Aug 24 12:35:03.866137 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 135/268] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:03.903921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:03.911648 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d6baa01d-5023-44cc-9d48-aebda9c552b1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1243 microversion: 2.1 time: 0.091358 Aug 24 12:35:03.912214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 134/269] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:03 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:04.694991 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:04.695597 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:04.703258 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.703748 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.704185 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.704907 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.705358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.705776 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.839945 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:04.840817 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:04.847827 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.848310 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.849020 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:04.849753 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:04.850202 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:04.850615 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.092669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.109673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-73dc025c-bdf5-4458-95d2-023e26ba97fa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1315 microversion: 2.1 time: 0.414400 Aug 24 12:35:05.123851 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 136/270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:04 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:05.129386 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:05.130279 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:05.137637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.138124 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.138557 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.139252 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.139904 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.140508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.485838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.494054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d13b6b22-10b8-4a45-8950-e940a6eaa655 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.658089 Aug 24 12:35:05.495592 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 135/271] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:04 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:05.511198 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:05.511886 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:05.522948 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.523669 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.524249 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.525127 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:05.540061 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:05.540906 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:05.696824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.716396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c1add15c-ef31-49e9-bf0a-60872c264e89 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.217595 Aug 24 12:35:05.718798 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 136/272] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:05 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:05.775193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:05.790965 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-33c71708-a9c8-494d-822e-e88e01d9f25e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.665046 Aug 24 12:35:05.792576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 137/273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:05 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:06.131251 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.131944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.142274 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.142995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.143653 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.144628 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.145402 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.146117 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.514986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.515603 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.518256 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:06.541373 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.541891 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.545373 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.546201 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.546862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.547447 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.609304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.619248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9bdc43d5-526c-44d1-abeb-d01284486f59 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.491803 Aug 24 12:35:06.635706 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 137/274] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:06.742245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.742923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.749943 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.760404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6f6033ef-428c-4a97-bef5-1d57292fe627 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.249383 Aug 24 12:35:06.763654 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 138/275] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:06.766063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.766846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.768181 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.769134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.769767 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.770363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.821395 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:06.822711 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:06.837896 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.849368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.850105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.851109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:06.851814 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:06.852407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:06.889697 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:06.903281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c387e5f5-4a9a-4940-8660-30335bcc421e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.165363 Aug 24 12:35:06.905148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 138/276] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:07.069159 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.078310 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-510a252a-8d50-4a77-84db-7f7464c558e1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.260652 Aug 24 12:35:07.079014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 139/277] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:06 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:07.642823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:07.643418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:07.650449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.650911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.651332 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.652077 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.652452 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.652896 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.787922 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:07.789350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:07.798144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.798977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.800211 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.801479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.802222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.802865 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.803566 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.812549 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ab83e6a5-6ab3-4458-a15c-6590ab25fd56 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.173635 Aug 24 12:35:07.813687 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 139/278] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:07 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:07.923437 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:07.924041 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:07.938140 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.938680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.939136 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.939878 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:07.940538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:07.940989 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:07.987044 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:07.995680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-04ce39f4-759a-4c8f-9746-aeb0f571d0ce tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.215668 Aug 24 12:35:08.009216 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 140/279] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:07 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:08.014026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:08.024343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d6ce0f1e-75a2-4cf2-b729-053f3f374d28 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.104289 Aug 24 12:35:08.025733 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 140/280] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:07 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:08.103031 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:08.104175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:08.112440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.113081 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.113969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.114450 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.114888 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.115477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.268472 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:08.279287 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b7ad234a-42b3-42b2-931c-d152a69c9706 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.180444 Aug 24 12:35:08.293799 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 141/281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:08 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:08.360166 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-489313304", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "networks": [{"uuid": "9b2a6781-39af-4f3c-89e6-6410bfa1c349"}]}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:08.428396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] validate_networks() for [('9b2a6781-39af-4f3c-89e6-6410bfa1c349', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:35:08.834912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:08.835741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:08.845263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.846946 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.847675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.849001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.849558 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.850075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.928854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:35:08.930090 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:35:08.930718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:35:08.931287 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:35:08.931844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:35:08.942184 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.942919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.943517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.944413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:08.945215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:08.945860 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:08.966242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Getting quotas for project e3e2e4f6da374afba391fec0fa0bb3fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:35:08.973982 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Getting quotas for user 35d65aef527d421c979e400774fc3fee and project e3e2e4f6da374afba391fec0fa0bb3fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:35:08.996626 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:35:08.999319 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:35:09.051343 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.054894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f32ee4c1-34b0-4f7a-bbec-ea2ffc3fce75 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699145 Aug 24 12:35:09.055846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 141/282] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:35:09.060977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-65c9fd25-2f4c-44aa-8bbe-ddc9fedae8c4 req-6d6c4158-1cc0-4b04-8385-e5881e28edf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92266f2b-5066-4d2e-b0a0-49f3ac0e3510", "name": "network-vif-plugged", "status": "completed", "tag": "8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:09.072035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-65c9fd25-2f4c-44aa-8bbe-ddc9fedae8c4 req-6d6c4158-1cc0-4b04-8385-e5881e28edf4 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.072779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-65c9fd25-2f4c-44aa-8bbe-ddc9fedae8c4 req-6d6c4158-1cc0-4b04-8385-e5881e28edf4 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.073237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-65c9fd25-2f4c-44aa-8bbe-ddc9fedae8c4 req-6d6c4158-1cc0-4b04-8385-e5881e28edf4 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.076585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b2fd421b-7429-4b32-8399-c164a2f7b670 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.245961 Aug 24 12:35:09.077841 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 142/283] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:08 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:09.084435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-65c9fd25-2f4c-44aa-8bbe-ddc9fedae8c4 req-6d6c4158-1cc0-4b04-8385-e5881e28edf4 service nova] Creating event network-vif-plugged:8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b for instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 on hv-cinder-84605 Aug 24 12:35:09.087113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:09.087662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:09.090369 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-65c9fd25-2f4c-44aa-8bbe-ddc9fedae8c4 req-6d6c4158-1cc0-4b04-8385-e5881e28edf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 Aug 24 12:35:09.091015 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 142/284] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:09.107249 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:09.110238 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:09.115280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.115980 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.116589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.117513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.118509 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.119091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.127571 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.128226 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.128876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.129938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.130544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.131109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.251135 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.295007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bcbd0673-4283-4c15-a483-b9c16153ef07 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.200866 Aug 24 12:35:09.298267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 143/285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:09 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:09.317395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-db5aaaf0-c40c-43a8-bc1d-d990c4de96c0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:09.318761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-db5aaaf0-c40c-43a8-bc1d-d990c4de96c0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:09.390927 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-db5aaaf0-c40c-43a8-bc1d-d990c4de96c0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.400175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.400375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-db5aaaf0-c40c-43a8-bc1d-d990c4de96c0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1218 microversion: 2.1 time: 0.086839 Aug 24 12:35:09.401265 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 144/286] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:09 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:09.406247 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:09.407066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:09.409128 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:09.409453 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dde11c8b-d6a9-4311-82d7-3eabe613f32c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.325923 Aug 24 12:35:09.410482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 143/287] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:09 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:09.430855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.431881 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.434284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.436079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:09.436779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:09.437633 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:09.620435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:09.629096 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8acd513e-c635-4310-a4b8-877489d9881f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.226938 Aug 24 12:35:09.629705 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 145/288] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:09 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:10.099692 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:10.101103 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:10.108096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.108973 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.109634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.110573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.111233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.111853 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.267133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.279605 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-909065b0-3ca5-41ed-a719-acf43bd6cab8 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.184964 Aug 24 12:35:10.280350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 144/289] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:10 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:10.319073 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:10.319677 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:10.326353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.326835 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.327267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.327952 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.328392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.328840 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.398608 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.408264 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-32561357-3eaf-4522-b29e-8f5fe6b55036 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.093021 Aug 24 12:35:10.408946 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 146/290] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:10 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:10.426232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:10.427019 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:10.433827 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.434709 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.435020 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.435723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.435834 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:10.436292 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.436724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:10.436964 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.443648 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.444124 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.444548 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.445268 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.445707 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.446119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.450305 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:10.518831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.526600 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0f352fb8-3f7e-4e23-ac0c-62d423c3915c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1222 microversion: 2.1 time: 0.105564 Aug 24 12:35:10.527489 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 145/291] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:10 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:10.622823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.630589 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-731b2309-c04f-4fc3-9375-b0eef27a6bb0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.200424 Aug 24 12:35:10.631203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 147/292] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:10 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:10.650450 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:10.651086 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:10.657102 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.657578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.657997 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.658676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:10.659126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:10.659534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:10.802293 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:10.814825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-95aac78b-1857-4d00-b5e3-e78b92b48c38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.168074 Aug 24 12:35:10.815492 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 146/293] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:10 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:11.299535 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.301041 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.307722 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.308782 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.309748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.311160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.311817 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.312435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.438437 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.439984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.451053 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.451532 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.451960 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.452669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.453129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.453534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.493697 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:11.505009 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.513176 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f7d58a82-a98a-4be5-a4cf-6f2c22c32ca4 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.217461 Aug 24 12:35:11.523200 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 148/294] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:11.547567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.548315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.560431 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.560676 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.561106 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.561801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.562240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.562652 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.563338 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.573458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-51a47c99-8e8e-4184-b7af-7be0562907c0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.146539 Aug 24 12:35:11.574904 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 147/295] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:11.638065 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.646837 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d497edbc-c179-4aaa-9608-087b3692f4b5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1222 microversion: 2.1 time: 0.103087 Aug 24 12:35:11.647433 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 149/296] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:11.650870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.651424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.658087 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.658576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.659003 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.659691 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.660149 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.660550 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.811192 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.819602 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-191ced20-cb67-44f7-aa59-8e344b620660 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.172543 Aug 24 12:35:11.820515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 148/297] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:11.836327 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:11.837214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:11.843806 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.844529 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.845164 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.846037 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:11.846636 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:11.847203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:11.989094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:11.999577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-57643c47-5106-4700-a22d-596fb85c6b58 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.166811 Aug 24 12:35:12.000696 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 150/298] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:11 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:12.536627 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.537305 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.539994 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=4 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:12.540744 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=20 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:12.549131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.549742 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.550308 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.551358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.551971 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.552567 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.595149 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.595994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.603019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.603515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.603954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.604674 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.606065 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.606500 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.688043 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.698945 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f2711af7-e01c-4cb3-bf3a-2bdcbb4ff985 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.107676 Aug 24 12:35:12.713442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 151/299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:12.718834 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.719445 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.725904 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.726394 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.726826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.727534 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.728014 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.728403 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.735487 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.743716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2e455e9c-a46a-48e5-9a04-a7d77d101ff1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.212903 Aug 24 12:35:12.755391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 149/300] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:12.817995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.826412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-afb5d410-4092-4581-a3fd-fbad189e1f3c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1222 microversion: 2.1 time: 0.111653 Aug 24 12:35:12.826994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 152/301] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:12.839333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:12.840038 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:12.846208 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.846677 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.847100 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.847774 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:12.848224 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:12.848634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:12.990310 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:12.998340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7384d5cf-2b44-4eb8-ac70-a2237c11ef2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.163026 Aug 24 12:35:12.998902 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 150/302] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:12 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:13.020817 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.021428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.027748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.028234 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.028695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.029384 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.029839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.030257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.179210 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.188932 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-10f7ea50-f6fe-4b6e-89df-47bf41f1447e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.171863 Aug 24 12:35:13.189785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 153/303] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:13.722548 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.723323 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.732110 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.732737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.733243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.734045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.734586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.735069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.764210 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.765058 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.776253 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.776811 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.777499 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.778218 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.778670 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.779094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.810102 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.818451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f5a775b9-3188-444a-8589-4dc9553b70f5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.101150 Aug 24 12:35:13.819248 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 151/304] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:13.853708 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:13.854429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:13.860891 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.861460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.861957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.862717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:13.863247 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:13.863726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:13.934584 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.942685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d4717832-8361-4d99-a497-4e9429162286 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1222 microversion: 2.1 time: 0.096770 Aug 24 12:35:13.943351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 152/305] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:13.960395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:13.969014 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ee3a401d-8d39-42c0-bf2c-5f1fff1bd006 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.208973 Aug 24 12:35:13.969590 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 154/306] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:13 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:14.019748 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.020666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.027554 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.028067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.028527 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.029363 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.029818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.030236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.179116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.187983 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4a9972d8-19a8-4d45-92f6-39d9f7fb635f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.172539 Aug 24 12:35:14.188687 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 153/307] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:14.209618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.210538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.216966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.217450 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.217875 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.218561 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.219005 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.219418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.358940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.369620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-cb455d4f-288a-4958-b859-89c7cd220657 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.163306 Aug 24 12:35:14.371120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 155/308] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:14.841745 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.842356 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.849179 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.849661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.850092 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.850776 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.851224 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.851632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.917608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:14.925942 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6bd2e917-55f2-4c90-a663-bc9e3e4fbb52 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.089522 Aug 24 12:35:14.929589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 154/309] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:14.965710 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.966342 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.973435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.974033 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.974469 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.975168 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.975623 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.976045 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.989824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:14.990476 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:14.996906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.997379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.997825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:14.998544 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:14.998971 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:14.999374 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.044999 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.053000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c45d2b01-efc7-406c-976e-cae7dfed726c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1222 microversion: 2.1 time: 0.091584 Aug 24 12:35:15.053553 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 156/310] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:15.155257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.163720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f3556932-b86d-4dc3-9d6c-916a73b7f4d3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.177670 Aug 24 12:35:15.164296 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 155/311] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:14 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:15.209190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:15.210557 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:15.217362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.218170 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.218530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.219324 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.219864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.220376 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.363725 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.372144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bbdea374-d28b-4940-9f14-b2009c34882b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.167384 Aug 24 12:35:15.372716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 157/312] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:15 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:15.394175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:15.395148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:15.402922 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.403416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.403847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.404553 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.405032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.405450 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.552219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:15.561726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d523fb69-5c37-409c-bcd9-4de30734da38 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.173895 Aug 24 12:35:15.562425 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 156/313] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:15 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:15.950714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:15.951230 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:15.957823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.958303 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.958733 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:15.959419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:15.959864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:15.960285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.026222 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:16.038784 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-212dc0a6-1e78-4047-854d-44b994e4ec83 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.093526 Aug 24 12:35:16.039686 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 158/314] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:15 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:16.082319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:16.083079 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:16.090144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.090638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.091073 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.091770 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.092223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.092628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.157574 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:16.165371 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-292436d9-7648-4aab-ae12-94c451dff621 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1222 microversion: 2.1 time: 0.088646 Aug 24 12:35:16.165931 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 157/315] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:16 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:16.187556 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:16.188416 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:16.197660 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.198158 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.198954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.199980 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.200431 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.201010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.393444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:16.394177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:16.400877 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.401826 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.402363 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.403123 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.403836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.404342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.614547 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:16.623069 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-068d3263-61e6-43e3-ab7b-071f4247651a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.441964 Aug 24 12:35:16.623658 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 159/316] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:16 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:16.628204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:16.629103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:16.635071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.635636 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.636193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:16.637038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:16.637563 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:16.638154 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.103751 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.112593 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8019fdef-acb5-42cd-a0e7-0a32f2124936 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.723175 Aug 24 12:35:17.113208 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 158/317] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:16 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:17.117579 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:17.118167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:17.124169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.124684 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.125545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.125835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.126515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.127112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.233631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.242878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-39c3e4a9-90e3-43e3-8e65-a0938ef5c0e1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1297 microversion: 2.1 time: 0.128639 Aug 24 12:35:17.243804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 159/318] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:17 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:17.262089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:17.263113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:17.269518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.270313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.270856 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.271683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.272203 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.273099 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.293944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.304724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fe11f568-ab5e-4dc1-9fb8-5707b554a145 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1711 microversion: 2.1 time: 0.680041 Aug 24 12:35:17.305879 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 160/319] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:16 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1711 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:17.388341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.396381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d50c46b4-34ef-44d6-ad81-2a5c7d47086e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1278 microversion: 2.1 time: 0.138372 Aug 24 12:35:17.397204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 160/320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:17 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:17.645277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:17.645905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:17.652279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.652794 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.653216 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.653915 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.654358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.654771 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.944363 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-ba4f5570-e35f-476f-8c98-58389168debe req-cfa37297-f864-4db7-8ee5-f6837a4561bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ca7d79-b522-4650-a770-396d9e60c8d1", "tag": "84866825-9b5e-4f5b-b6e1-614b038c9651"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:17.952483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:17.955011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ba4f5570-e35f-476f-8c98-58389168debe req-cfa37297-f864-4db7-8ee5-f6837a4561bb service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:17.955506 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ba4f5570-e35f-476f-8c98-58389168debe req-cfa37297-f864-4db7-8ee5-f6837a4561bb service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:17.955923 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ba4f5570-e35f-476f-8c98-58389168debe req-cfa37297-f864-4db7-8ee5-f6837a4561bb service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:17.961475 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b533e299-1758-4a2e-a1c4-ebe09946ac8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.320415 Aug 24 12:35:17.974721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 161/321] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:17 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:17.974950 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-ba4f5570-e35f-476f-8c98-58389168debe req-cfa37297-f864-4db7-8ee5-f6837a4561bb service nova] Creating event network-changed:84866825-9b5e-4f5b-b6e1-614b038c9651 for instance 17ca7d79-b522-4650-a770-396d9e60c8d1 on hv-cinder-84605 Aug 24 12:35:17.978509 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-ba4f5570-e35f-476f-8c98-58389168debe req-cfa37297-f864-4db7-8ee5-f6837a4561bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037784 Aug 24 12:35:17.980043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 161/322] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:18.134444 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.135051 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.142029 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.142520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.142955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.143655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.144106 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.144526 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.265349 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.266128 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.272466 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.272982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.273620 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.274323 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.275225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.275225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.293828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.302504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5fa64617-b5fd-4e0f-a567-72f6d072e405 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1370 microversion: 2.1 time: 0.171995 Aug 24 12:35:18.312942 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 162/323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:18.327926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.328533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.334919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.335401 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.335828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.336544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.337448 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.337448 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.450498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.458583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3c175b57-84fd-458b-ae39-b365df250a90 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1364 microversion: 2.1 time: 0.198879 Aug 24 12:35:18.459232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 162/324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:18.463632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.464768 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.471023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.471530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.471961 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.473092 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.473558 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.473976 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.498461 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.502012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:18.507893 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c3eb0813-cd1d-4116-b0db-7ec1294072c4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1715 microversion: 2.1 time: 0.184463 Aug 24 12:35:18.508426 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 163/325] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1715 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:18.537443 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:18.545239 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0184a233-28af-4a1c-ba15-111440306ba1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1276 microversion: 2.1 time: 0.085055 Aug 24 12:35:18.545807 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 163/326] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:18.982786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:18.983393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:18.985640 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=4 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:18.991081 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.991562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.991987 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:18.992687 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:18.993149 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:18.993561 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.325009 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:19.325741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:19.332891 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.333379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.333925 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.334704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.335188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.335607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.378294 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.387221 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f88ba7c5-8fc6-43ec-9c2a-7a11b9a9add6 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.408658 Aug 24 12:35:19.387827 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 164/327] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:18 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:19.480225 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:19.481228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:19.483144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=22 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:19.488981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.489484 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.489943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.490646 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:19.491098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:19.491521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:19.994690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:19.999090 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:20.004228 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-266adce1-f822-4ac0-82c6-ee39cc2cc14f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1565 microversion: 2.1 time: 0.683294 Aug 24 12:35:20.005079 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 164/328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:19 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1565 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:20.010297 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.011105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.018515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.019002 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.019439 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.020162 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.020616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.021072 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.179623 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.188608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6f32740e-5599-4a2d-9004-3b95e6260956 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1276 microversion: 2.1 time: 0.182605 Aug 24 12:35:20.189136 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 165/329] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:20.193963 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.194446 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.200868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.201362 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.201794 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.202501 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.202924 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.203359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.227365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cfa6bf19-eb96-4426-895b-9390e09593fd tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/ips" status: 200 len: 151 microversion: 2.20 time: 0.037159 Aug 24 12:35:20.227914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 166/330] 10.222.0.27 () {60 vars in 1289 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:35:20.232448 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.232890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.243370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.244247 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.244726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.246627 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.247108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.247535 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.262599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.281402 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-17eb7fc5-41b1-475f-9c1d-89124297a398 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1364 microversion: 2.1 time: 0.805454 Aug 24 12:35:20.282281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 165/331] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:19 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1364 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:20.410588 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:20.411325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:20.411669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3cf4fa7b-812e-45f7-a320-e39118decbc0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181374 Aug 24 12:35:20.413496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 167/332] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-interface => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:20.418715 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.419513 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.420123 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.421249 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.422027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.422714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.898624 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-f0fb33c4-4529-4afb-9618-4dd781eb1a2d req-56c79ab3-d9f8-49f0-ae6f-6b5be1de7781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d90b9b-40b9-4bdd-981a-cd8c18281f3a", "tag": "d973b062-e8ab-4ee5-836a-848846c35103"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:20.899868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:20.911824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-db855f22-efce-4c27-a6d5-3c202a5ec492 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.507123 Aug 24 12:35:20.912859 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 166/333] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:20 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:20.913851 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f0fb33c4-4529-4afb-9618-4dd781eb1a2d req-56c79ab3-d9f8-49f0-ae6f-6b5be1de7781 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:20.914365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f0fb33c4-4529-4afb-9618-4dd781eb1a2d req-56c79ab3-d9f8-49f0-ae6f-6b5be1de7781 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:20.917438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f0fb33c4-4529-4afb-9618-4dd781eb1a2d req-56c79ab3-d9f8-49f0-ae6f-6b5be1de7781 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:20.940271 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-f0fb33c4-4529-4afb-9618-4dd781eb1a2d req-56c79ab3-d9f8-49f0-ae6f-6b5be1de7781 service nova] Creating event network-changed:d973b062-e8ab-4ee5-836a-848846c35103 for instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a on hv-cinder-84605 Aug 24 12:35:20.949974 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-f0fb33c4-4529-4afb-9618-4dd781eb1a2d req-56c79ab3-d9f8-49f0-ae6f-6b5be1de7781 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055194 Aug 24 12:35:20.951141 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 168/334] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:21.211400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:21.212182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:21.219627 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.220272 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.220854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.221837 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.222403 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.223088 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.303900 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:21.304985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:21.312410 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.313336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.313771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.314453 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.315232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.315618 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.788701 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.797920 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f17129a2-4d36-4915-a0d3-60ec91b55b48 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.591078 Aug 24 12:35:21.799102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 167/335] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:21 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:21.804558 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-3f11db22-aa32-4787-9541-f490d71b1cd3 req-61878b05-29dd-4a5a-9556-730bc9ea6a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92266f2b-5066-4d2e-b0a0-49f3ac0e3510", "tag": "8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:21.815384 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-3f11db22-aa32-4787-9541-f490d71b1cd3 req-61878b05-29dd-4a5a-9556-730bc9ea6a66 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.816184 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-3f11db22-aa32-4787-9541-f490d71b1cd3 req-61878b05-29dd-4a5a-9556-730bc9ea6a66 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.816823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-3f11db22-aa32-4787-9541-f490d71b1cd3 req-61878b05-29dd-4a5a-9556-730bc9ea6a66 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.829384 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-3f11db22-aa32-4787-9541-f490d71b1cd3 req-61878b05-29dd-4a5a-9556-730bc9ea6a66 service nova] Creating event network-changed:8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b for instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 on hv-cinder-84605 Aug 24 12:35:21.835342 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-3f11db22-aa32-4787-9541-f490d71b1cd3 req-61878b05-29dd-4a5a-9556-730bc9ea6a66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034128 Aug 24 12:35:21.836701 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 168/336] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:21.898482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:21.913069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1ce58a79-0a93-4e72-be29-0a57b83b82d3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1364 microversion: 2.1 time: 0.613368 Aug 24 12:35:21.919400 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 169/337] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:21 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1364 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:21.934912 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:21.935581 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:21.942768 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.943304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.943658 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:21.944612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:21.945242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:21.945818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.172498 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:22.180960 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a6fba248-7406-472d-8b5c-9d65b6c8d206 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.251303 Aug 24 12:35:22.184775 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 169/338] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:21 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:22.664571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:22.665211 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:22.672469 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.673051 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.673519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.674267 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.674719 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.675127 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.699026 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lazy-loading 'flavor' on Instance uuid 6ac6a7ad-e418-48a8-8e4b-a1449c35183a {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:35:22.821415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:22.822019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:22.828834 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.829405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.829831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.830516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.831022 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.831445 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.890079 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-18f543c8-b435-4506-91f7-dcd1fcf106c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/action" status: 202 len: 0 microversion: 2.20 time: 0.229397 Aug 24 12:35:22.891011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 170/339] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 24 12:35:22 2022] POST /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:35:22.899342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:22.900119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:22.907405 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.907892 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.908330 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:22.909066 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:22.909511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:22.909932 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.527040 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.534891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8aa78e68-3e63-4bb3-adbd-3c75d7da62da tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.717234 Aug 24 12:35:23.535389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 170/340] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:22 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:23.551923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:23.552518 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:23.558667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.559502 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.559911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.560620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.561093 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.561515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.607518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.616421 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.617970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.619131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a4725298-f7ff-4e51-a7e5-1fe9e143f6b5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.723899 Aug 24 12:35:23.620065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 171/341] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:22 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:23.625589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:23.626208 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:23.632214 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.632728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.633227 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.633919 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.634373 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.634793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.774789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.783193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f7badacb-4a5e-4825-9cb7-cf34d8459c1d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1364 microversion: 2.1 time: 0.246841 Aug 24 12:35:23.783785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 171/342] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:23 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:23.788269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-5c136d36-78a8-4bf4-9fba-5a2fbba55700 req-a7cbdddd-5bf6-4cc0-a64a-9e25586674ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4edcf956-07b2-424c-be9a-9d40ca998261", "tag": "1fb65d33-c6ad-43e7-b7c5-4ee698ac2fb4"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:23.797842 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-5c136d36-78a8-4bf4-9fba-5a2fbba55700 req-a7cbdddd-5bf6-4cc0-a64a-9e25586674ae service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:23.798318 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-5c136d36-78a8-4bf4-9fba-5a2fbba55700 req-a7cbdddd-5bf6-4cc0-a64a-9e25586674ae service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:23.798746 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-5c136d36-78a8-4bf4-9fba-5a2fbba55700 req-a7cbdddd-5bf6-4cc0-a64a-9e25586674ae service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:23.805314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:23.810508 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-5c136d36-78a8-4bf4-9fba-5a2fbba55700 req-a7cbdddd-5bf6-4cc0-a64a-9e25586674ae service nova] Creating event network-changed:1fb65d33-c6ad-43e7-b7c5-4ee698ac2fb4 for instance 4edcf956-07b2-424c-be9a-9d40ca998261 on hv-cinder-84605 Aug 24 12:35:23.813632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-293109c3-417b-469f-b21a-f1b261686fce tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.192787 Aug 24 12:35:23.814231 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 172/343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:23 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:23.815357 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-5c136d36-78a8-4bf4-9fba-5a2fbba55700 req-a7cbdddd-5bf6-4cc0-a64a-9e25586674ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030467 Aug 24 12:35:23.815929 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 172/344] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:24.559952 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:24.560572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:24.567421 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.567926 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.568374 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.569114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.569597 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.570042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.646920 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:24.647680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:24.655605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.656072 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.656504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:24.657245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:24.657702 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:24.658129 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.059182 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.069468 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-33464df7-4c61-4ab4-a2d2-85bb53c03207 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.516271 Aug 24 12:35:25.070373 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 173/345] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:24 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:25.078892 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:25.080132 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:25.087824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.089294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.089725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.090682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.091666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.093120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.121208 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.132882 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.134814 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.136665 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c7e8dd9b-fc80-4ab1-987a-df8e1a605857 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.496778 Aug 24 12:35:25.154981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 173/346] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:24 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:25.160100 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:25.162048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:25.168672 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.169311 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.169839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.170629 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:25.171289 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:25.171775 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:25.575927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.584432 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e44086f5-84fe-46ad-bbf8-c48910acb5ef tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1364 microversion: 2.1 time: 0.512825 Aug 24 12:35:25.585717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 174/347] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:25 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1364 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:25.587337 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:25.595733 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3df62149-a0c3-4a1b-aa87-7ed6c2e4890d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.439360 Aug 24 12:35:25.596501 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 174/348] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:25 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:26.091677 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:26.092372 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:26.099004 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.099486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.099911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.100601 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.101080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.101495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.169868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:26.170408 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:26.177515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.178218 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.178641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.179331 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.179775 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.180185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.261656 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.269956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-39831f2f-9572-46f1-af57-0de0f823add4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.182059 Aug 24 12:35:26.271063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 175/349] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:26 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:26.336207 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.344605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.346190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.347339 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0d4805ad-5c0d-44a0-848f-2bf5223ef74a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.182065 Aug 24 12:35:26.347914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 175/350] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:26 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:26.608852 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:26.609461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:26.615161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:26.615839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.616014 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:26.616328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.616804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.617500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.617957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.618387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.622492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.622971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.623391 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.624071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:26.624513 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:26.624961 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:26.980965 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:26.989132 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cbc4bcd8-5a81-479f-bfe4-624bac8941e3 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1364 microversion: 2.1 time: 0.384226 Aug 24 12:35:26.989803 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 176/351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:26 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1364 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:27.015889 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.023998 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ee85b4fc-074b-4da1-b514-af75b3938118 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.412549 Aug 24 12:35:27.024543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 176/352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:26 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:27.297236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:27.298159 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:27.305735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.306270 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.306689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.307997 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.308891 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.309395 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.370983 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:27.371586 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:27.378771 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.379293 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.379726 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.380429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.380905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.381323 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.730980 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.741889 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e50204df-1d73-488a-b7c4-2b2ece65a4b8 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.449825 Aug 24 12:35:27.742793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 177/353] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:27 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:27.768974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.777883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.779316 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:27.780480 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b8ca6199-a96f-4e1e-925a-57b793f5b351 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.413709 Aug 24 12:35:27.781760 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 177/354] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:27 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:27.955792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-b80d9e2a-518c-464d-b9dd-5c434e7497af req-29e517fe-dfe9-44ed-b6df-42d9692f0761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d90b9b-40b9-4bdd-981a-cd8c18281f3a", "name": "network-vif-plugged", "status": "completed", "tag": "d973b062-e8ab-4ee5-836a-848846c35103"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:27.965781 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b80d9e2a-518c-464d-b9dd-5c434e7497af req-29e517fe-dfe9-44ed-b6df-42d9692f0761 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:27.966261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b80d9e2a-518c-464d-b9dd-5c434e7497af req-29e517fe-dfe9-44ed-b6df-42d9692f0761 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:27.966687 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b80d9e2a-518c-464d-b9dd-5c434e7497af req-29e517fe-dfe9-44ed-b6df-42d9692f0761 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:27.978986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-b80d9e2a-518c-464d-b9dd-5c434e7497af req-29e517fe-dfe9-44ed-b6df-42d9692f0761 service nova] Creating event network-vif-plugged:d973b062-e8ab-4ee5-836a-848846c35103 for instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a on hv-cinder-84605 Aug 24 12:35:27.986910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-b80d9e2a-518c-464d-b9dd-5c434e7497af req-29e517fe-dfe9-44ed-b6df-42d9692f0761 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035426 Aug 24 12:35:27.987701 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 178/355] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:28.010694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:28.011291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:28.017565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.018048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.018484 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.019171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.019618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.020038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.046379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:28.047784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:28.056065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.056756 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.058053 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.059506 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.060226 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.060808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.244238 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.251160 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.265426 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-068deb60-bbbc-4dda-97cd-0c282b8e6e64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1364 microversion: 2.1 time: 0.258701 Aug 24 12:35:28.266018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 178/356] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:28 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:28.273028 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f91b25f4-8e23-46ba-9346-3cb7182ffb4c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.231853 Aug 24 12:35:28.273594 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 179/357] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:28 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:28.764926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:28.765562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:28.771686 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.772182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.772616 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.773329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.773772 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.774187 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.805382 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:28.805980 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:28.813416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.813906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.814379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.815108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:28.815564 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:28.815983 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:28.958896 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.968485 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-eb3c2e7c-f8f9-417b-8d6d-9e8cff1f4a2f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.207933 Aug 24 12:35:28.969226 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 179/358] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:28 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:28.982948 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.991437 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.993105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:28.994536 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a49fb3f9-1234-4429-be60-712a0a8cbd1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.192996 Aug 24 12:35:28.995650 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 180/359] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:28 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:29.287346 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:29.288291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:29.296684 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:29.297335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:29.303593 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.303749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.304164 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.304389 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.304579 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.305045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.305490 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.305939 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.306055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:29.306363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.306574 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:29.307126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:29.331210 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:29.506009 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.514707 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f492a719-8422-49a1-a564-1ac4078a50d9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1364 microversion: 2.1 time: 0.231709 Aug 24 12:35:29.515268 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 180/360] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:29 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:29.525654 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:29.535607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-63bb6bb3-fa3e-4b5f-b0c1-a6c95477bb4f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.242851 Aug 24 12:35:29.536254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 181/361] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:29 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:29.991723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:29.992538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:29.999901 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.000380 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.000890 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.001559 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.002015 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.002435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.018003 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:30.018708 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:30.025412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.026143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.026794 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.027450 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.027912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.028340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.208986 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.216136 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.220443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:30.227937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.229746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.230905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-edc717fe-16d8-4080-a9e4-4574800f009a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.217060 Aug 24 12:35:30.231467 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 182/362] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:30 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:30.235112 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ac3ea72e-cd9f-457f-ac1d-fcd0c43c82f6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.248169 Aug 24 12:35:30.235783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 181/363] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:29 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:30.239821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-81e8a763-7890-4638-8524-96d2b7d07b06 req-39aaedda-1dff-40c7-8c97-894e80365e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ca7d79-b522-4650-a770-396d9e60c8d1", "name": "network-vif-plugged", "status": "completed", "tag": "84866825-9b5e-4f5b-b6e1-614b038c9651"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:30.249715 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-81e8a763-7890-4638-8524-96d2b7d07b06 req-39aaedda-1dff-40c7-8c97-894e80365e61 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.250218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-81e8a763-7890-4638-8524-96d2b7d07b06 req-39aaedda-1dff-40c7-8c97-894e80365e61 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.250636 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-81e8a763-7890-4638-8524-96d2b7d07b06 req-39aaedda-1dff-40c7-8c97-894e80365e61 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.262048 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-81e8a763-7890-4638-8524-96d2b7d07b06 req-39aaedda-1dff-40c7-8c97-894e80365e61 service nova] Creating event network-vif-plugged:84866825-9b5e-4f5b-b6e1-614b038c9651 for instance 17ca7d79-b522-4650-a770-396d9e60c8d1 on hv-cinder-84605 Aug 24 12:35:30.266718 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-81e8a763-7890-4638-8524-96d2b7d07b06 req-39aaedda-1dff-40c7-8c97-894e80365e61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Aug 24 12:35:30.267298 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 183/364] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:30.537926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:30.538436 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:30.546873 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.547369 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.547839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.548507 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.549240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.549813 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.559620 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:30.561417 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:30.569634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.570126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.570761 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.571652 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.572258 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.572725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.773087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.776222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:30.781824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-19084acc-f486-447a-9e13-1216f4a8b996 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1554 microversion: 2.1 time: 0.247972 Aug 24 12:35:30.784057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cedf8213-c72b-4753-a4ae-ff0677c1724f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.229754 Aug 24 12:35:30.784622 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 184/365] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:30 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:30.788994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 182/366] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:30 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:30.802229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:30.802749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:30.809598 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.810079 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.810511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.811194 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:30.811643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:30.812063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:30.891698 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f02fc841-91f2-45a5-b1ed-cfbdc1bca7dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092853 Aug 24 12:35:30.892586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 185/367] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 12:35:30 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:31.254519 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:31.255103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:31.255984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:31.256610 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:31.261883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.262361 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.262653 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.262761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.263155 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.263542 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.263732 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.264031 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.264451 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.265266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.265763 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.266220 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.475798 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.479792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.488132 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fdc9823e-ecc7-46cc-806a-38a3ff7880a4 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.236655 Aug 24 12:35:31.489622 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 186/368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:31 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:31.491311 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.492855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.494024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-85eb7bf5-c933-49f3-b3b8-d838e8f7fe53 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.243492 Aug 24 12:35:31.495323 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 183/369] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:31 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:31.804590 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:31.805225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:31.812319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.812868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.813299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.814057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.814508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.814927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.863569 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-66077951-545c-42a8-9b57-4f92c3d23283 req-5abd6c4b-a367-4123-9126-f44386111bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d90b9b-40b9-4bdd-981a-cd8c18281f3a", "tag": "d973b062-e8ab-4ee5-836a-848846c35103"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:31.874832 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-66077951-545c-42a8-9b57-4f92c3d23283 req-5abd6c4b-a367-4123-9126-f44386111bab service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:31.875318 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-66077951-545c-42a8-9b57-4f92c3d23283 req-5abd6c4b-a367-4123-9126-f44386111bab service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:31.875753 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-66077951-545c-42a8-9b57-4f92c3d23283 req-5abd6c4b-a367-4123-9126-f44386111bab service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:31.894546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-66077951-545c-42a8-9b57-4f92c3d23283 req-5abd6c4b-a367-4123-9126-f44386111bab service nova] Creating event network-changed:d973b062-e8ab-4ee5-836a-848846c35103 for instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a on hv-cinder-84605 Aug 24 12:35:31.899723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-66077951-545c-42a8-9b57-4f92c3d23283 req-5abd6c4b-a367-4123-9126-f44386111bab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041276 Aug 24 12:35:31.900738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 184/370] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:35:31.956333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:31.965788 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b2121cff-984b-419a-a541-2feff38e9e55 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1357 microversion: 2.1 time: 0.164788 Aug 24 12:35:31.966375 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 187/371] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:31 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:32.286780 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-05093c13-b1f4-475e-a389-cbb7cc2332fe req-13b8c551-9e2a-4e7f-ad21-43329df01578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edcf956-07b2-424c-be9a-9d40ca998261", "name": "network-vif-plugged", "status": "completed", "tag": "1fb65d33-c6ad-43e7-b7c5-4ee698ac2fb4"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:32.298058 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-05093c13-b1f4-475e-a389-cbb7cc2332fe req-13b8c551-9e2a-4e7f-ad21-43329df01578 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.298533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-05093c13-b1f4-475e-a389-cbb7cc2332fe req-13b8c551-9e2a-4e7f-ad21-43329df01578 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.298957 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-05093c13-b1f4-475e-a389-cbb7cc2332fe req-13b8c551-9e2a-4e7f-ad21-43329df01578 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.311341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-05093c13-b1f4-475e-a389-cbb7cc2332fe req-13b8c551-9e2a-4e7f-ad21-43329df01578 service nova] Creating event network-vif-plugged:1fb65d33-c6ad-43e7-b7c5-4ee698ac2fb4 for instance 4edcf956-07b2-424c-be9a-9d40ca998261 on hv-cinder-84605 Aug 24 12:35:32.316354 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-05093c13-b1f4-475e-a389-cbb7cc2332fe req-13b8c551-9e2a-4e7f-ad21-43329df01578 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035801 Aug 24 12:35:32.317230 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 185/372] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:32.510862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:32.511426 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:32.513955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:32.519844 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.520020 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:32.520330 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.520773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:32.521976 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.523573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.524390 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.525819 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.528274 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.529030 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.529662 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.530597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.531039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.531617 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.779566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.789088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1e74f520-8251-4a25-b81e-49c64c48c364 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.282195 Aug 24 12:35:32.789717 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 188/373] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:32 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:32.844355 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.853001 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.854625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:32.855995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b3e682d6-4a79-42c7-b8c9-9be5f2a63929 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.341722 Aug 24 12:35:32.858026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 186/374] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:32 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:32.988134 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:32.988821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:32.995511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.996890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.997412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:32.998870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:32.999431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:32.999908 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.136011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.143867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6cce282f-b360-4c8f-8410-24807b57c3eb tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1546 microversion: 2.1 time: 0.159597 Aug 24 12:35:33.144425 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 189/375] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:32 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:33.164338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:33.165129 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:33.171411 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.171887 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.172325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.173066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.173513 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.173927 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.303412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.311527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b75e33cb-de83-4322-8bea-a87cec80bb2c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1546 microversion: 2.1 time: 0.151007 Aug 24 12:35:33.312121 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 187/376] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:33 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:33.334833 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:33.342686 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.343738 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Searching by: {'deleted': False, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e'} {{(pid=127298) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 12:35:33.354438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.354937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.355379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.356105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.356583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.357006 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.451550 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.multi_cell_list [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127298) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 12:35:33.544876 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-59dc1ac4-abed-46e0-84d0-b18c31e21dae tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.216983 Aug 24 12:35:33.545533 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 190/377] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Aug 24 12:35:33 2022] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:33.560777 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:33.561392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:33.567798 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.568283 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.568790 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.569469 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.569923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.570349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.708169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:33.716987 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c6efb197-8c5f-4380-8ffd-5cc06b084489 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1546 microversion: 2.1 time: 0.160609 Aug 24 12:35:33.717550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 188/378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:33 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:33.810911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:33.811648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:33.817870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.818359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.818794 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.819482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.819932 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.820350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.879145 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:33.879756 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:33.886121 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.886521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.886993 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:33.887689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:33.888141 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:33.888563 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:34.042704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.051628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3e945f6f-8734-4064-b100-5a7acfe74ee5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.244940 Aug 24 12:35:34.052698 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 191/379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:33 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:34.132086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.140940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.142425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:34.143570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-223fb9f6-09db-47da-8366-ee6bdd392eba tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.268343 Aug 24 12:35:34.144106 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 189/380] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:33 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:35.074127 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:35.074855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:35.082186 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.082308 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.082752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.083463 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.084069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.084498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.168567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:35.169210 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:35.175544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.176049 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.176470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.177186 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.177628 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.178039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.245589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:35.255355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6e4c275c-cd13-4c42-9abd-0d56a5b32f0f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1318 microversion: 2.1 time: 0.185028 Aug 24 12:35:35.257158 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 192/381] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:35 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:35.325693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3177171-1144-4464-8d7c-ec569b2f8c4c"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:35.328065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:35.335099 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.335584 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.336033 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.336793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:35.337246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:35.337662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:35.347908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:35.356594 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:35.358224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:35.359597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c2eb8acd-0598-47ab-aae8-6d402265e6bf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.197438 Aug 24 12:35:35.360150 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 190/382] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:35 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:35.628828 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2e0beb1d-0697-4a8f-a591-0e2342612aa1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "POST /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306939 Aug 24 12:35:35.629526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 193/383] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:35:35 2022] POST /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:36.277979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:36.278571 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:36.285460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:36.285945 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:36.286375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:36.287052 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:36.287504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:36.287925 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:36.383491 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:36.384173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:36.392122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:36.392787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:36.393225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:36.393919 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:36.394399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:36.394822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:36.433595 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:36.442173 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-aa5cbd3d-4975-4e4a-be30-a6655142c010 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1507 microversion: 2.1 time: 0.168438 Aug 24 12:35:36.442747 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 191/384] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:36 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:36.545309 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:36.554603 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:36.556328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:36.557658 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8876384c-5b6a-400d-a14e-ea68f7b3edb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.178913 Aug 24 12:35:36.558765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 194/385] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:36 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:37.583960 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:37.585148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:37.594995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:37.595803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:37.596496 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:37.597689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:37.598421 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:37.599102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:37.740800 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.749261 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.750767 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:37.751929 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8d92cde4-66ae-490c-9263-d8ebaff97e4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.173898 Aug 24 12:35:37.752873 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 192/386] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:37 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:38.776675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:38.777279 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:38.784037 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:38.784519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:38.784979 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:38.785663 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:38.786110 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:38.786493 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:38.930358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.939558 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.941075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:38.942220 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-586d7cff-712f-4591-842a-7165664c5e27 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.169656 Aug 24 12:35:38.942785 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 195/387] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:38 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:39.966064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:39.966694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:39.969252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=96 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:39.974590 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:39.975003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:39.975433 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:39.976128 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:39.976578 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:39.977028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:40.119804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:40.128064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:40.129595 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:40.130757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2df4532a-57f3-4aa2-a0ca-98f96ba7de19 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.169207 Aug 24 12:35:40.131314 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 193/388] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:39 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:41.154489 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:41.155111 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:41.162184 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:41.162659 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:41.163088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:41.163769 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:41.164357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:41.164812 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:41.311004 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:41.319908 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:41.321710 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:41.323065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0eac97d6-185b-4a23-a493-fa0249d16c1f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.172868 Aug 24 12:35:41.323677 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 196/389] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:41 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:42.347157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:42.347765 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:42.354930 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:42.355380 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:42.356049 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:42.356766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:42.357216 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:42.357638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:42.509884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:42.518367 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:42.519864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:42.521260 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a6f72f4e-1b86-41d6-bce0-23837a53bdc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.178314 Aug 24 12:35:42.521811 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 194/390] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:42 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:43.545991 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:43.546612 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:43.549581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:43.555854 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:43.556424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:43.556906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:43.557949 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:43.558442 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:43.558879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:43.578326 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:43.703904 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:43.717409 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:43.719818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:43.721768 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1492ada5-dce0-4f38-ac0b-f8e12a26bd0a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.180276 Aug 24 12:35:43.722676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 197/391] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:43 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:44.322987 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:44.323643 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:44.330384 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:44.330853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:44.331284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:44.331974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:44.332422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:44.332877 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:44.479444 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:44.491365 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-54a4b231-9a0f-4ee0-bc67-070567355621 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1592 microversion: 2.1 time: 0.172035 Aug 24 12:35:44.492142 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 195/392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:44 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1592 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:35:44.746847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:44.747392 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:44.753872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:44.754335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:44.754784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:44.755642 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:44.756096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:44.756512 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:44.981389 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:44.990878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:44.992377 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:44.993543 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a5c64b27-b9da-4f95-b8be-15c3f2cb8b63 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.250919 Aug 24 12:35:44.994313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 198/393] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:44 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:46.016385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:46.017036 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:46.023974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:46.024499 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:46.024944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:46.025737 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:46.026304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:46.026745 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:46.388765 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:46.399491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:46.401648 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:46.403215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e3c0b64f-eafa-4b96-a3cf-8c5490ce4643 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.391023 Aug 24 12:35:46.403982 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 196/394] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:46 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:46.705065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-42628c1b-4bf1-4019-ba99-23d7df970a7a req-0d0f9764-d862-4a24-b7a4-0968bba5c81e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ca7d79-b522-4650-a770-396d9e60c8d1", "tag": "84866825-9b5e-4f5b-b6e1-614b038c9651"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:46.725808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-42628c1b-4bf1-4019-ba99-23d7df970a7a req-0d0f9764-d862-4a24-b7a4-0968bba5c81e service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:46.726146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-42628c1b-4bf1-4019-ba99-23d7df970a7a req-0d0f9764-d862-4a24-b7a4-0968bba5c81e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:46.726737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-42628c1b-4bf1-4019-ba99-23d7df970a7a req-0d0f9764-d862-4a24-b7a4-0968bba5c81e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:46.742421 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-42628c1b-4bf1-4019-ba99-23d7df970a7a req-0d0f9764-d862-4a24-b7a4-0968bba5c81e service nova] Creating event network-changed:84866825-9b5e-4f5b-b6e1-614b038c9651 for instance 17ca7d79-b522-4650-a770-396d9e60c8d1 on hv-cinder-84605 Aug 24 12:35:46.748555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-42628c1b-4bf1-4019-ba99-23d7df970a7a req-0d0f9764-d862-4a24-b7a4-0968bba5c81e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050362 Aug 24 12:35:46.749946 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 199/395] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:47.430075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:47.435603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:47.443910 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:47.444363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:47.444594 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:47.445343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:47.445788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:47.446199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:47.787917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:47.797665 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:47.799429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:47.800852 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a289487e-b225-48f9-9d32-9e4e61f6174e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.374725 Aug 24 12:35:47.802036 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 197/396] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:47 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:48.081148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2034035103"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:48.082511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:48.093709 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:48.094609 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:48.094734 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:48.095450 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:48.095924 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:48.096315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:48.235894 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.network.security_group_api [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Adding security group 538e2495-21a2-4bf8-9dd0-75ff2fdc3319 to port 84866825-9b5e-4f5b-b6e1-614b038c9651 Aug 24 12:35:48.635552 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b989e2c7-27d5-4845-b75a-a0de6a994060 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "POST /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.559277 Aug 24 12:35:48.636142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 200/397] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:35:48 2022] POST /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:35:48.644696 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:48.645333 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:48.652162 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:48.653333 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:48.653761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:48.654446 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:48.654888 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:48.655299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:48.768835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-aa2e1230-4c4e-4041-a1e3-53240954e549 req-393cbc99-66be-441f-96ce-e0935bd03a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ca7d79-b522-4650-a770-396d9e60c8d1", "tag": "84866825-9b5e-4f5b-b6e1-614b038c9651"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:48.779156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-aa2e1230-4c4e-4041-a1e3-53240954e549 req-393cbc99-66be-441f-96ce-e0935bd03a0a service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:48.779920 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-aa2e1230-4c4e-4041-a1e3-53240954e549 req-393cbc99-66be-441f-96ce-e0935bd03a0a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:48.780452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-aa2e1230-4c4e-4041-a1e3-53240954e549 req-393cbc99-66be-441f-96ce-e0935bd03a0a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:48.792961 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-aa2e1230-4c4e-4041-a1e3-53240954e549 req-393cbc99-66be-441f-96ce-e0935bd03a0a service nova] Creating event network-changed:84866825-9b5e-4f5b-b6e1-614b038c9651 for instance 17ca7d79-b522-4650-a770-396d9e60c8d1 on hv-cinder-84605 Aug 24 12:35:48.799584 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-aa2e1230-4c4e-4041-a1e3-53240954e549 req-393cbc99-66be-441f-96ce-e0935bd03a0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033677 Aug 24 12:35:48.800822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 201/398] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:48.825138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:48.825996 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:48.832390 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:48.833199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:48.833707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:48.834474 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:48.834979 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:48.835585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:49.008446 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:49.018315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a9bbfcce-d5bd-4b2b-b1ea-814d58e9059a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1758 microversion: 2.1 time: 0.377533 Aug 24 12:35:49.019529 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 198/399] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:35:48 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1758 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:35:49.189196 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:49.199462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:49.201395 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:49.202751 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-89e2d54f-9f32-4071-9cc2-9e00ca21db47 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.382576 Aug 24 12:35:49.214006 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 202/400] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:48 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:50.228926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:50.229855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:50.240559 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:50.241358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:50.242024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:50.243075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:50.243798 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:50.244215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:50.386977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:50.391771 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:35:50.401097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:50.403483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:50.405277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6b2771e5-182d-4ddf-99a5-a7bbf50d0604 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1744 microversion: 2.20 time: 0.182319 Aug 24 12:35:50.406047 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 199/401] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:50 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:51.433882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:51.434473 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:51.441433 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:51.441916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:51.442343 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:51.443030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:51.443478 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:51.443892 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:51.584318 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:51.592808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:51.594294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:51.595481 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-51024fbd-fea1-43a9-b1ad-7ae74005465b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1744 microversion: 2.20 time: 0.167185 Aug 24 12:35:51.596042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 203/402] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:51 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:52.630535 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:52.632420 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:52.645839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:52.646329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:52.646763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:52.647456 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:52.647913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:52.648331 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:52.803466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:52.812143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:52.813679 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:52.814839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c0ce0ad0-9d77-4e39-be92-b9254477c07e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1744 microversion: 2.20 time: 0.197412 Aug 24 12:35:52.815427 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 200/403] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:52 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1744 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:53.276963 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-5555d507-362c-4086-bcf5-fd607ff13623 req-44d87cf5-d07a-4d91-b7b5-4f99888acabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac6a7ad-e418-48a8-8e4b-a1449c35183a", "name": "network-vif-plugged", "status": "completed", "tag": "2846875a-a14c-495e-a9aa-ea984a5071c2"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:53.287110 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5555d507-362c-4086-bcf5-fd607ff13623 req-44d87cf5-d07a-4d91-b7b5-4f99888acabd service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:53.287590 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5555d507-362c-4086-bcf5-fd607ff13623 req-44d87cf5-d07a-4d91-b7b5-4f99888acabd service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:53.288272 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5555d507-362c-4086-bcf5-fd607ff13623 req-44d87cf5-d07a-4d91-b7b5-4f99888acabd service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:53.300730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-5555d507-362c-4086-bcf5-fd607ff13623 req-44d87cf5-d07a-4d91-b7b5-4f99888acabd service nova] Creating event network-vif-plugged:2846875a-a14c-495e-a9aa-ea984a5071c2 for instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a on hv-cinder-84605 Aug 24 12:35:53.306848 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-5555d507-362c-4086-bcf5-fd607ff13623 req-44d87cf5-d07a-4d91-b7b5-4f99888acabd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033769 Aug 24 12:35:53.307721 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 204/404] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:53.837789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:53.838388 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:53.845001 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:53.845485 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:53.845918 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:53.846618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:53.847054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:53.847492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:54.000804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:54.009334 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:54.011028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:54.012276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f96f5a74-5dc3-47dd-812a-2944d42463a4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.178681 Aug 24 12:35:54.020695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 201/405] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:53 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:55.039086 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:55.039772 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:55.046859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:55.047339 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:55.047778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:55.048513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:55.049023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:55.049443 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:55.189193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:55.197625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:55.199105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:55.200244 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-76a74308-ead0-45b4-8455-aeb7bc59708d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.166201 Aug 24 12:35:55.200831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 205/406] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:55 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:35:56.223841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:56.224567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:56.233032 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:56.233810 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:56.234592 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:56.235304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:56.235755 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:56.236183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:56.402412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:56.414376 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:56.416352 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:56.417556 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f58dd1f9-e865-4be6-aeb7-53fd61daa232 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.198177 Aug 24 12:35:56.418303 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 202/407] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:56 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:57.064763 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90b96119-9815-4db3-b18c-9c5f388bb460", "device": "/dev/sdb"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:35:57.068076 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:57.075509 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:57.076002 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:57.076496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:57.077328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:57.077949 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:57.078370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:57.387907 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5db61eda-2313-4138-aee9-ed68dfcc2de0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "POST /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327300 Aug 24 12:35:57.388574 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 206/408] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:35:57 2022] POST /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:35:57.440609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:57.441235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:57.448248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:57.449180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:57.449808 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:57.450521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:57.451113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:57.451676 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:57.605270 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:57.613925 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:57.615512 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:57.616908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0038663d-d2a5-4fed-aaff-142d2681fb05 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.180330 Aug 24 12:35:57.617823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 203/409] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:57 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:58.640508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:58.641874 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:58.649384 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:58.650255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:58.650660 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:58.651416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:58.651816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:58.652254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:58.818013 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:58.827307 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:58.828882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:35:58.830046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5f000983-9249-414d-8849-3ac7b3f196c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.194037 Aug 24 12:35:58.830755 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 207/410] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:58 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:35:59.856021 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:35:59.857326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:35:59.864462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.864963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.865389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:35:59.866075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:35:59.866516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:35:59.866929 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:00.027675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:00.039285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:00.041302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:00.045084 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d09964c6-e455-4487-9bf8-99987c011fd1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.193103 Aug 24 12:36:00.046143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 204/411] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:35:59 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:01.073440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:01.074117 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:01.080936 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.081662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.082261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.083250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:01.084502 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:01.085721 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:01.246529 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:01.258808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:01.260869 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:01.262704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2260641a-1761-439f-a000-399e25c4507f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.196478 Aug 24 12:36:01.263566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 208/412] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:01 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:02.289174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:02.290179 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:02.297573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:02.298475 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:02.298916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:02.299639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:02.300095 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:02.300516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:02.481891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:02.491363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:02.492229 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:02.493739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-14148af5-2dee-47c0-9f19-8e7254b1054c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.210700 Aug 24 12:36:02.494698 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 205/413] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:02 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:03.521752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:03.522675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:03.525668 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=42 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:03.531144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:03.531653 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:03.532087 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.532825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:03.533273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:03.533690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:03.664139 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:03.680704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:03.682703 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:03.683854 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4a8ad08f-226d-4eef-9ab2-5e438a815456 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1739 microversion: 2.20 time: 0.168102 Aug 24 12:36:03.684415 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 209/414] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:03 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:04.710421 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:04.711348 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:04.720125 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:04.720899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:04.721412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:04.722202 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:04.722703 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:04.723331 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:04.884418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:04.892917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:04.894400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:04.895515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-365c29aa-f387-433f-88ac-e99c5d20f030 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1721 microversion: 2.20 time: 0.191592 Aug 24 12:36:04.896064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 206/415] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:04 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:05.923012 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:05.924237 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:05.934417 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.934911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.935392 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:05.936049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:05.936583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:05.937350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:06.085065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:06.094876 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:06.096404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:06.097588 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1cfaf8a2-6d41-40b5-8a50-f423285c2d78 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1721 microversion: 2.20 time: 0.181149 Aug 24 12:36:06.098175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 210/416] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:05 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:07.120902 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:07.121458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:07.127907 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:07.128396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:07.128883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:07.129611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:07.130092 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:07.130513 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:07.263314 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:07.271757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:07.273312 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:07.274557 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3ded8cea-c468-464a-ae24-77ded556f960 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1721 microversion: 2.20 time: 0.157895 Aug 24 12:36:07.275109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 207/417] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:07 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:08.301554 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:08.302410 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:08.314239 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.315027 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.315739 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.316917 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:08.317663 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:08.318359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:08.459646 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:08.471594 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:08.473886 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:08.475607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f0c2318a-8f87-4506-951d-2560dec1ef0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1721 microversion: 2.20 time: 0.180574 Aug 24 12:36:08.476428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 211/418] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:08 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:09.495112 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-f216a2ef-171f-4fb7-bf51-66b430d3cb58 req-02344dce-b33a-4d4a-9337-f2eac334868a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac6a7ad-e418-48a8-8e4b-a1449c35183a", "name": "network-vif-unplugged", "status": "completed", "tag": "2846875a-a14c-495e-a9aa-ea984a5071c2"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:09.498384 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:09.499021 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:09.505742 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f216a2ef-171f-4fb7-bf51-66b430d3cb58 req-02344dce-b33a-4d4a-9337-f2eac334868a service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.506349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f216a2ef-171f-4fb7-bf51-66b430d3cb58 req-02344dce-b33a-4d4a-9337-f2eac334868a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.506763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f216a2ef-171f-4fb7-bf51-66b430d3cb58 req-02344dce-b33a-4d4a-9337-f2eac334868a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.518735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.519315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.519774 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.520789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-f216a2ef-171f-4fb7-bf51-66b430d3cb58 req-02344dce-b33a-4d4a-9337-f2eac334868a service nova] Creating event network-vif-unplugged:2846875a-a14c-495e-a9aa-ea984a5071c2 for instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a on hv-cinder-84605 Aug 24 12:36:09.525387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:09.525927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:09.526227 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-f216a2ef-171f-4fb7-bf51-66b430d3cb58 req-02344dce-b33a-4d4a-9337-f2eac334868a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034888 Aug 24 12:36:09.526711 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:09.527353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 208/419] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:09.658873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:09.667542 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:09.669047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:09.670262 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1bcdf6c9-6718-4eda-92c8-996a88d9b8c9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1721 microversion: 2.20 time: 0.176407 Aug 24 12:36:09.670975 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 212/420] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:09 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:10.694875 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:10.695844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:10.697630 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=32 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:10.702744 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.703220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.703645 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.704994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.705822 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.706578 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.848546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:10.857884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:10.860305 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:10.861504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-dc3eedad-149c-445f-9e0b-1d93fcb63bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1664 microversion: 2.20 time: 0.171532 Aug 24 12:36:10.862071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 209/421] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:10 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:10.883742 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e28fadc9-0292-4025-9f53-f96259945a38"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:10.886308 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:10.893064 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.893546 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.893972 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:10.894647 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:10.895089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:10.895500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.097004 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:11.192160 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ee7f534f-412f-4ed0-a720-6e361c3731f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312522 Aug 24 12:36:11.192806 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 213/422] 10.222.0.27 () {62 vars in 1364 bytes} [Wed Aug 24 12:36:10 2022] POST /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:36:11.319134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:11.319733 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:11.326625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.327108 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.327542 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.328218 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.328689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.329113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.372853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127299) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 12:36:11.450023 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e62dbb3a-5a06-4330-8ca8-3bc3598bd56d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/action" status: 202 len: 0 microversion: 2.20 time: 0.135078 Aug 24 12:36:11.451444 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 210/423] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 24 12:36:11 2022] POST /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:36:11.458815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:11.459424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:11.466257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.466739 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.467173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.467866 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:11.468337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:11.468795 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:11.608998 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:11.617822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:11.619313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:11.620486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7052a2df-f8e0-41de-88d0-5ddba8869a69 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1750 microversion: 2.20 time: 0.165644 Aug 24 12:36:11.621076 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 214/424] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:11 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:36:12.646862 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:12.647761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:12.654763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:12.655254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:12.655828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:12.656367 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:12.656847 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:12.657266 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:12.790945 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:12.800343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:12.801880 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:12.803027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-390689e3-ceea-42dd-8ba1-82ce2fcaea5f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1750 microversion: 2.20 time: 0.162304 Aug 24 12:36:12.803588 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 211/425] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:12 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:13.831027 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:13.831647 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:13.838913 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.839396 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.839833 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:13.840517 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:13.841007 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:13.841429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:14.224333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:14.233425 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:14.235018 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:14.236183 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-32635b2a-8242-485b-9e28-0edb108f0a2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1750 microversion: 2.20 time: 0.409119 Aug 24 12:36:14.236775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 215/426] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:13 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1750 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:15.260543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:15.261193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:15.267904 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:15.268389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:15.268860 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.269567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:15.270026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:15.270442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:15.414028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:15.423429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:15.424962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:15.426154 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7867fa4e-1144-4809-afea-79774803ddff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.170087 Aug 24 12:36:15.426715 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 212/427] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:15 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:16.455065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:16.455878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:16.464640 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.465151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.465581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.466267 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:16.466719 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:16.467136 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:16.602256 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:16.611331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:16.612880 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:16.614045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c83afdd4-e544-414c-a91e-0db8768af3a1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.166188 Aug 24 12:36:16.614618 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 216/428] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:16 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:17.647725 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:17.648690 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:17.655557 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:17.656037 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:17.656471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:17.657191 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:17.657640 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:17.658062 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:17.799451 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:17.810591 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:17.812090 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:17.813291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8153d529-0fb0-4abd-b8d9-2e20054f2d74 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.172093 Aug 24 12:36:17.813860 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 213/429] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:17 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:18.703395 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:18.704003 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:18.710314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:18.711114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:18.711256 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:18.711986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:18.712440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:18.712868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:18.837344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:18.837984 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:18.844661 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:18.845187 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:18.845596 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:18.846289 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:18.846763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:18.847181 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:18.857238 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lazy-loading 'services' on Instance uuid 0c0c5601-af7b-4464-a37d-63b475832ae5 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:18.985374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:18.991917 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c8b9791a-c6b5-4513-9549-d2782a165d14 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/os-volume_attachments/df45523f-4950-43ae-82d2-0cbba458e72b" status: 202 len: 0 microversion: 2.1 time: 0.292108 Aug 24 12:36:18.993444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 217/430] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:36:18 2022] DELETE /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/os-volume_attachments/df45523f-4950-43ae-82d2-0cbba458e72b => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:18.995466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:19.001549 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:19.003119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-28a7dec1-fef7-46be-bbaf-4f955155c98e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.170492 Aug 24 12:36:19.004041 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 214/431] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:18 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:36:20.031743 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:20.032500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:20.041642 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:20.042320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:20.042832 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:20.043695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:20.044327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:20.044960 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:20.207216 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:20.216589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:20.218119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:20.219288 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0ae82373-0352-404d-b62e-facee8c9fbf4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.195508 Aug 24 12:36:20.219856 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 218/432] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:20 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:21.245700 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:21.246443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:21.254455 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:21.255701 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:21.256379 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:21.257300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:21.258065 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:21.258824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:21.432781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:21.442903 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:21.444779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:21.446025 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-88b73390-10b9-4016-9beb-131d09b3a210 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.206850 Aug 24 12:36:21.446589 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 215/433] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:21 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:22.420674 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:22.425195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:22.433002 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.433492 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.433923 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.434627 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.435074 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.435495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.468971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:22.469605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:22.478276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.478774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.479204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.479908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:22.480356 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:22.480801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:22.485592 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:22.518565 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lazy-loading 'services' on Instance uuid 4edcf956-07b2-424c-be9a-9d40ca998261 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:22.613243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1c3063b0-3d8a-4e4a-8166-229ad1ade140 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261/os-volume_attachments/90b96119-9815-4db3-b18c-9c5f388bb460" status: 202 len: 0 microversion: 2.1 time: 0.195548 Aug 24 12:36:22.614330 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 219/434] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:36:22 2022] DELETE /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261/os-volume_attachments/90b96119-9815-4db3-b18c-9c5f388bb460 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:22.636370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:22.648116 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:22.650168 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:22.651360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d1952424-9c3e-423e-9e66-fefe84ee5106 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.186318 Aug 24 12:36:22.652245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 216/435] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:22 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:23.680200 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:23.681202 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:23.688067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:23.688555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:23.689016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:23.692688 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:23.692688 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:23.692688 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:23.856337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:23.865179 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:23.866743 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:23.868100 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-614b64f7-bbcd-4d03-b76a-c853dc953bcf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.195345 Aug 24 12:36:23.868694 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 220/436] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:23 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:24.894147 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:24.894791 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:24.902188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.902668 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.903101 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:24.904122 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:24.904808 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:24.905488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:25.075559 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:25.084993 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:25.086668 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:25.087848 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c33a30e5-8c48-4a0c-874d-f0cbb0288c68 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.197741 Aug 24 12:36:25.097421 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 217/437] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:24 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:26.113578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:26.114154 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:26.122572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.123046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.123480 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.124185 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:26.124639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:26.125080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:26.275099 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:26.283781 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:26.285420 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:26.286605 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d04dd4f9-4ec1-4978-99e8-51b558a7215a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.179574 Aug 24 12:36:26.287226 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 221/438] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:26 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:27.315214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:27.316041 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:27.324803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:27.325337 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:27.325803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:27.326501 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:27.327110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:27.327499 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:27.461918 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:27.470943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:27.472432 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:27.473645 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-342442dc-2511-4f05-81b0-e104336fdcbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.165417 Aug 24 12:36:27.474202 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 218/439] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:27 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:27.508317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81aeefe5-5eb5-40e7-971d-a71289131ebc"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:27.511918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:27.520218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:27.520736 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:27.521131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:27.521847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:27.522305 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:27.522772 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.496831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:28.497469 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:28.504512 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.505074 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.505507 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.506246 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:28.506700 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:28.507161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:28.656974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.670321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.671828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:28.678614 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8ba480e7-6dcb-4276-975c-3a37b2bcd077 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.185728 Aug 24 12:36:28.692979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 219/440] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:28 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:36:29.703688 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:29.704286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:29.711425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.711914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.712341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:29.713094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:29.713547 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:29.713968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:29.857130 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:29.865761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:29.867979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:29.869192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8fa4fc44-a58c-423c-a69b-9412a46dce0e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.169652 Aug 24 12:36:29.869763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 220/441] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:29 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:30.896735 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:30.897957 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:30.908719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:30.909543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:30.910346 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:30.911478 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:30.912222 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:30.913119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:31.052934 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:31.063849 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:31.065322 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:31.066483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3ef4cc0e-bc9c-4715-9b6f-63ee0d9dee3f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.176456 Aug 24 12:36:31.067034 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 221/442] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:30 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:31.767808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1fc33f6e-4190-43e5-9df2-111fc14da1d4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.265381 Aug 24 12:36:31.770868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 222/443] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:36:27 2022] POST /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments => generated 194 bytes in 4267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:36:32.097311 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:32.097906 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:32.105131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:32.105613 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:32.106053 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:32.106731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:32.107187 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:32.107607 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:32.252361 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:32.261935 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:32.263442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:32.264600 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3cd1639f-344c-4c1b-923b-85f7ce69a006 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.171295 Aug 24 12:36:32.265201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 222/444] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:32 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:32.945593 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-77ef6603-0872-4932-b727-041080476f35 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:32.952628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77ef6603-0872-4932-b727-041080476f35 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:32.953131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77ef6603-0872-4932-b727-041080476f35 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:32.953564 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77ef6603-0872-4932-b727-041080476f35 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:32.974960 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-77ef6603-0872-4932-b727-041080476f35 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Going to try to stop instance {{(pid=127298) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 12:36:33.020313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-77ef6603-0872-4932-b727-041080476f35 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.079588 Aug 24 12:36:33.020956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 223/445] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:36:32 2022] POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:33.029478 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:33.030092 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:33.039106 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:33.039593 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:33.040035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:33.040761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:33.041220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:33.041647 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:33.187994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:33.198675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ce6dd6d3-1c49-49e6-ae58-0f40312bd53d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1725 microversion: 2.1 time: 0.172983 Aug 24 12:36:33.199241 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 223/446] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:33 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:33.289611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:33.290304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:33.297328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:33.297808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:33.298234 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:33.298913 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:33.299354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:33.299764 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:33.445371 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:33.454521 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:33.456045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:33.457245 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-db1238df-4142-4896-8b0f-99692a58bb52 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.172576 Aug 24 12:36:33.457800 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 224/447] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:33 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:34.219514 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:34.220124 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:34.228263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.228778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.229211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.229910 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.230354 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.230773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.374576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:34.382596 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2b60edea-a559-4c19-9013-bf5384cffe4d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.166982 Aug 24 12:36:34.383169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 224/448] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:34 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:34.481016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:34.481615 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:34.484044 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=32 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:34.489170 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.489656 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.490089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.490787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:34.491272 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:34.491692 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:34.511393 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:34.635936 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:34.644678 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:34.646194 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:34.647320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ff0f8466-567c-4756-9251-7d6675fa62e3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.170524 Aug 24 12:36:34.647999 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 225/449] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:34 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:35.407820 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:35.408813 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:35.418262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.418770 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.419256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.419959 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.420416 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.420934 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.498374 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:35.498942 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:35.505293 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.505782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.506218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.507659 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.508365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.508821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.536711 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:36:35.568225 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.576328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5bc8dcad-69cc-4f53-a810-55c15627f8ca tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.176308 Aug 24 12:36:35.576852 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 225/450] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:35 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:35.623954 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f1327e19-bb23-4c8c-a4d8-bb5a9e744115 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 204 len: 0 microversion: 2.1 time: 0.129187 Aug 24 12:36:35.624543 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 226/451] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:36:35 2022] DELETE /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:36:35.633126 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:35.633757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:35.639689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.640165 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.640591 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.641320 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.641764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.642179 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.675952 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:35.676643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:35.683315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.683804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.684231 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.684961 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:35.685432 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:35.685848 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:35.827798 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.836135 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8e40b670-cb74-481f-ade6-236f03e5d47c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1513 microversion: 2.1 time: 0.207014 Aug 24 12:36:35.836713 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 226/452] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:35 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:35.855968 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.868635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.870159 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:35.871307 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e30386d2-8c3d-46fa-b8a4-a805ccefabd7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.199599 Aug 24 12:36:35.871864 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 227/453] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:35 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:36.124761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-58b3fd1b-a9e9-4261-938b-8affbb924bbf req-c9711537-e3b9-49bd-974b-5c8609dda81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac6a7ad-e418-48a8-8e4b-a1449c35183a", "name": "network-vif-plugged", "status": "completed", "tag": "2846875a-a14c-495e-a9aa-ea984a5071c2"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:36.135589 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-58b3fd1b-a9e9-4261-938b-8affbb924bbf req-c9711537-e3b9-49bd-974b-5c8609dda81e service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.136319 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-58b3fd1b-a9e9-4261-938b-8affbb924bbf req-c9711537-e3b9-49bd-974b-5c8609dda81e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.136753 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-58b3fd1b-a9e9-4261-938b-8affbb924bbf req-c9711537-e3b9-49bd-974b-5c8609dda81e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.151896 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-58b3fd1b-a9e9-4261-938b-8affbb924bbf req-c9711537-e3b9-49bd-974b-5c8609dda81e service nova] Creating event network-vif-plugged:2846875a-a14c-495e-a9aa-ea984a5071c2 for instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a on hv-cinder-84605 Aug 24 12:36:36.156913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-58b3fd1b-a9e9-4261-938b-8affbb924bbf req-c9711537-e3b9-49bd-974b-5c8609dda81e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036017 Aug 24 12:36:36.157508 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 227/454] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:36.602715 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:36.603338 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:36.613500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.614223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.614862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.615958 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.616778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.617204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.748706 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:36.759137 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-74bd22ca-be18-4a62-a9a9-52c9d6e66d78 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.163652 Aug 24 12:36:36.759681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 228/455] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:36 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:36.859013 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:36.859577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:36.866819 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.867292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.867713 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.868396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.868874 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.869292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.894221 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:36.894953 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:36.901616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.902100 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.902534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:36.903222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:36.903671 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:36.904089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.051921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.061657 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bfa69758-af17-4d47-8d57-bd160b9d288e tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1513 microversion: 2.1 time: 0.207017 Aug 24 12:36:37.062544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 228/456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:36 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:37.086300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.095112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.096609 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.097791 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5982c29e-5276-4d72-a9f2-b0f609811546 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.207517 Aug 24 12:36:37.098371 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 229/457] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:36 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:37.784737 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:37.785724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:37.793352 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:37.793826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:37.794251 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.794937 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:37.795383 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:37.795797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:37.935123 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:37.943258 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a2d0d207-f797-43f3-a4b8-49e8052e9dfc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.164882 Aug 24 12:36:37.943869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 229/458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:37 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:38.088017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:38.088580 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:38.100089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.100089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.100089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.100089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.101632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.101632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.121175 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:38.121782 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:38.129396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.129892 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.130330 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.131101 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.131948 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.131948 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.457709 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:38.466489 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5bc858d6-e011-40f3-b531-ad3ca696de56 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1513 microversion: 2.1 time: 0.383206 Aug 24 12:36:38.476737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 230/459] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:38 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1513 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:38.477219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:38.486241 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:38.487755 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:38.488965 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-af5c0076-c4ee-4f0c-832b-9db4a99e5aa6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.371740 Aug 24 12:36:38.489551 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 230/460] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:38 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:38.833538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-76e9bf32-e60c-41e3-9d75-aabcabcbf583 req-25f39117-604c-4b5b-a9d9-9e8f49fb8a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edcf956-07b2-424c-be9a-9d40ca998261", "name": "network-vif-deleted", "tag": "1fb65d33-c6ad-43e7-b7c5-4ee698ac2fb4"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:38.845531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-76e9bf32-e60c-41e3-9d75-aabcabcbf583 req-25f39117-604c-4b5b-a9d9-9e8f49fb8a41 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.845995 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-76e9bf32-e60c-41e3-9d75-aabcabcbf583 req-25f39117-604c-4b5b-a9d9-9e8f49fb8a41 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.846415 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-76e9bf32-e60c-41e3-9d75-aabcabcbf583 req-25f39117-604c-4b5b-a9d9-9e8f49fb8a41 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.859008 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-76e9bf32-e60c-41e3-9d75-aabcabcbf583 req-25f39117-604c-4b5b-a9d9-9e8f49fb8a41 service nova] Creating event network-vif-deleted:1fb65d33-c6ad-43e7-b7c5-4ee698ac2fb4 for instance 4edcf956-07b2-424c-be9a-9d40ca998261 on hv-cinder-84605 Aug 24 12:36:38.865082 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-76e9bf32-e60c-41e3-9d75-aabcabcbf583 req-25f39117-604c-4b5b-a9d9-9e8f49fb8a41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035067 Aug 24 12:36:38.865882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 231/461] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:38.965943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:38.966630 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:38.973612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.974085 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.974526 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:38.975387 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:38.976068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:38.976496 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.122029 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.133127 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8284d843-df01-4719-85bd-85a7467985f4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.171088 Aug 24 12:36:39.133724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 231/462] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:38 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:39.488988 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:39.489719 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:39.497112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:39.497591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:39.498024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.498719 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:39.499226 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:39.499604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.511562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:39.512249 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:39.518543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:39.519298 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:39.519726 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.520416 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:39.520905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:39.521325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.534682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:39.535180 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:39.535609 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:39.536038 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lazy-loading 'fault' on Instance uuid 4edcf956-07b2-424c-be9a-9d40ca998261 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:39.590223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.598328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-96ba9d63-5254-44bb-82ea-f91265839e47 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1308 microversion: 2.1 time: 0.113664 Aug 24 12:36:39.598936 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 232/463] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:39 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:39.682792 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.696386 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.698816 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:39.700252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f160edd1-8889-4d1d-8391-9c9f9995f542 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.192406 Aug 24 12:36:39.701172 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 232/464] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:39 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:40.163415 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:40.164032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.170847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.171433 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.172351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.173381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.174047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.175108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.320334 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.328215 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b6a5c117-3b9e-48c8-b89e-0c7194591a54 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.170058 Aug 24 12:36:40.328815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 233/465] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:40 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:40.527668 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:40.528219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.535708 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.536197 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.536627 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.537444 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.537927 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.538347 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.557377 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:40.565086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-89f89dfe-fd42-47c2-b77e-9beea2c6f67d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a/ips" status: 200 len: 149 microversion: 2.1 time: 0.041826 Aug 24 12:36:40.565650 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 233/466] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:36:40 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:40.578831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff155a9-a517-4c4e-9863-d537b84f522b"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:40.581286 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.589444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.590029 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.590491 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.591218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.591671 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.592089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.619097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:40.619739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.625745 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.626313 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.626878 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.627669 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.628173 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.628637 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.660838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.661315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.661740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.662355 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lazy-loading 'fault' on Instance uuid 4edcf956-07b2-424c-be9a-9d40ca998261 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:40.674283 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Invalid volume: volume 4ff155a9-a517-4c4e-9863-d537b84f522b is already attached to instances: 056ae6fc-add8-4682-ad3d-ab4072db60f5 Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: POST /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a/os-volume_attachments HTTP/1.1 Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 74 Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:36:40.676151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {"volumeAttachment": {"volumeId": "4ff155a9-a517-4c4e-9863-d537b84f522b"}} Aug 24 12:36:40.677531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Invalid volume: volume 4ff155a9-a517-4c4e-9863-d537b84f522b is already attached to instances: 056ae6fc-add8-4682-ad3d-ab4072db60f5 Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'server_id': 'd1d90b9b-40b9-4bdd-981a-cd8c18281f3a', 'body': {'volumeAttachment': {'volumeId': '4ff155a9-a517-4c4e-9863-d537b84f522b'}}} Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4ff155a9-a517-4c4e-9863-d537b84f522b is already attached to instances: 056ae6fc-add8-4682-ad3d-ab4072db60f5 Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:40.678304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4ff155a9-a517-4c4e-9863-d537b84f522b is already attached to instances: 056ae6fc-add8-4682-ad3d-ab4072db60f5 Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:40.680682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:40.682129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:40.682129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:36:40.682129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:36:40.682129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4ff155a9-a517-4c4e-9863-d537b84f522b is already attached to instances: 056ae6fc-add8-4682-ad3d-ab4072db60f5 Aug 24 12:36:40.682129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:40.682129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 400 to user: Invalid volume: volume 4ff155a9-a517-4c4e-9863-d537b84f522b is already attached to instances: 056ae6fc-add8-4682-ad3d-ab4072db60f5 {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:36:40.682129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e6787945-43cf-4b65-9c4f-7c431956b615 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103318 Aug 24 12:36:40.682129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 234/467] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:36:40 2022] POST /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:36:40.688090 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:40.688692 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.695455 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.696045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.696515 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.697310 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.697818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.698382 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.717379 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.724780 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:36:40.725638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a22c125f-caad-4ae0-ac72-cb7ad8471ad7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 200 len: 1308 microversion: 2.1 time: 0.110346 Aug 24 12:36:40.726212 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 234/468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:40 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:40.730836 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:40.731429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.733325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:40.739120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.739651 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.740079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.740955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.741344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.741761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.807840 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-729a9ccb-9aef-47f5-814f-5a44499f252f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 204 len: 0 microversion: 2.1 time: 0.123193 Aug 24 12:36:40.808848 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 235/469] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:36:40 2022] DELETE /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:36:40.817346 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:40.818052 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:40.825195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.825683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.826129 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.826821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:40.827292 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:40.827711 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:40.923208 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.943087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.945066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.946968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e17fb931-bed4-47e2-959e-f455a41dfd59 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1808 microversion: 2.20 time: 0.219527 Aug 24 12:36:40.961407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 235/470] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:40 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:40.987743 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:40.996545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8e5e3412-ad29-44cc-ad16-bc877f6eaefe tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1678 microversion: 2.1 time: 0.183536 Aug 24 12:36:40.997155 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 236/471] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:40 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:41.353552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:41.354618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:41.362797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.363286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.364075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:41.364552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.365025 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.365596 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:41.497757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:41.508071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-54520cf1-3a4d-42e8-97ad-a9e170432b1f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.159260 Aug 24 12:36:41.508670 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 236/472] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:41 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:41.747370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:41.747939 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 4edcf956-07b2-424c-be9a-9d40ca998261] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:41.754925 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.755404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.755834 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:41.756617 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.757102 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.757522 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:41.771561 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] HTTP exception thrown: Instance 4edcf956-07b2-424c-be9a-9d40ca998261 could not be found. Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Request method failure captured: Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 HTTP/1.1 Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhr6zdDU-6fR4OINSpO__82za3Dt25Jw3WmlNDX5rmjf89WN1xvk5wY4RSVbENSn6CBnZwixIqW_JZQgBRGbn7CZYSHES4c_lmQCzKh2WyzY5bzCIvubNVfnNcbhF4YzKuJq8kkddi78mFwv8S5Ruklyzczvq-D3Q9bk_A9pnhBTmsg Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: e3e2e4f6da374afba391fec0fa0bb3fb Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1904912420 Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:36:41.773391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3e2e4f6da374afba391fec0fa0bb3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3e2e4f6da374afba391fec0fa0bb3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3e2e4f6da374afba391fec0fa0bb3fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3e2e4f6da374afba391fec0fa0bb3fb"}]}] Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesSnapshotTestJSON-1904912420 Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: e3e2e4f6da374afba391fec0fa0bb3fb Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1904912420 Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesSnapshotTestJSON-1904912420-project Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 35d65aef527d421c979e400774fc3fee Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesSnapshotTestJSON-1904912420-project Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 4edcf956-07b2-424c-be9a-9d40ca998261 could not be found. Aug 24 12:36:41.774951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '4edcf956-07b2-424c-be9a-9d40ca998261'} Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edcf956-07b2-424c-be9a-9d40ca998261 could not be found. Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:36:41.775824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edcf956-07b2-424c-be9a-9d40ca998261 could not be found. Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edcf956-07b2-424c-be9a-9d40ca998261 could not be found. Aug 24 12:36:41.777164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:41.778414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Returning 404 to user: Instance 4edcf956-07b2-424c-be9a-9d40ca998261 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:36:41.778414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0ebc26f2-4e7c-4047-8e94-dcf9ef5cb2a3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261" status: 404 len: 111 microversion: 2.1 time: 0.031265 Aug 24 12:36:41.778414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 237/473] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:41 2022] GET /compute/v2.1/servers/4edcf956-07b2-424c-be9a-9d40ca998261 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:36:41.970695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:41.971298 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:41.978131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.978874 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.979474 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:41.980224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:41.980641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:41.981068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.019254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:42.019782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:42.026760 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:42.030919 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:42.040204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.041024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:42.041506 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:42.041942 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.155702 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.165334 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.166925 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.168185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d729b3ef-18cd-4a5e-a103-b58a7b075015 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1795 microversion: 2.20 time: 0.201407 Aug 24 12:36:42.168786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 237/474] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:36:41 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1795 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:36:42.203223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.211002 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-acdcf82c-4d7d-4983-9022-76a3457a43ed tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1678 microversion: 2.1 time: 0.195653 Aug 24 12:36:42.211565 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 238/475] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:42 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:42.531193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:42.532004 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:42.541024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:42.541669 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:42.542249 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.543166 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:42.543775 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:42.544340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:42.693711 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:42.706498 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-75084754-d5fa-4583-9834-af4ca0a5c981 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.180062 Aug 24 12:36:42.707295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 238/476] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:42 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:43.240149 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:43.241423 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:43.250039 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.250527 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.250960 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.251661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.252114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.252533 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.396232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:43.400090 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:43.405131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2d1e9f9e-7ac6-42dc-b1ee-acce23f91bcc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1678 microversion: 2.1 time: 0.175465 Aug 24 12:36:43.405712 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 239/477] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:43 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:43.541112 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:43.543472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:43.550666 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.551150 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.551588 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.552277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.552730 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.554127 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.632968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ad649dc1-bbea-4443-906a-6620b81fda7a tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "POST /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.095786 Aug 24 12:36:43.633768 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 239/478] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:36:43 2022] POST /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:43.642172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:43.642820 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:43.649268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.649747 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.650178 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.650868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.651345 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.651766 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.728926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:43.729921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:43.736081 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.736570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.737086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.737782 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:43.738234 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:43.738656 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:43.833074 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:43.845983 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-23b859e9-9071-4490-9ac7-a93567286ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1750 microversion: 2.1 time: 0.207681 Aug 24 12:36:43.846915 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 240/479] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:43 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1750 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:43.902677 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:43.914416 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a5f5aaf6-786d-482e-8c4b-fb019e6c0f5a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.189798 Aug 24 12:36:43.915122 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 240/480] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:43 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:44.436874 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:44.437882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:44.447221 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.447700 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.448133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.448868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.449395 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.449809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.588451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:44.596412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9796020f-46d2-4f9e-8347-ee48489e59a8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1678 microversion: 2.1 time: 0.165953 Aug 24 12:36:44.596982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 241/481] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:44 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:44.868430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:44.869027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:44.875974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.876463 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.876928 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.877618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.878065 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.878480 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.940203 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:44.941914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:44.951725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.952588 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.953242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:44.954012 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:44.954647 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:44.955046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:45.090899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:45.099907 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5897a1d0-d98b-4715-a80f-107555046ea1 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1750 microversion: 2.1 time: 0.236016 Aug 24 12:36:45.100487 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 241/482] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:44 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1750 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:45.129336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:45.137125 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-768634ac-db95-44c3-ae05-5b13c7d7e9a8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.201342 Aug 24 12:36:45.137696 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 242/483] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:44 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:45.617861 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:45.618465 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:45.624520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:45.625030 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:45.625456 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:45.626141 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:45.626581 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:45.626978 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:45.825875 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:45.834544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a6e5b25c-4f47-42d9-a680-fd624acb0dc4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1678 microversion: 2.1 time: 0.220460 Aug 24 12:36:45.848640 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 242/484] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:45 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:46.120679 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:46.121262 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:46.128407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.129023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.129386 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.130098 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.131139 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.131496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.158117 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:46.158717 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:46.165954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.166695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.167276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.168131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.168755 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.169368 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.838638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:46.846762 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b5f1bdf2-6ae7-4129-9212-8c48ff8b10d2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.692452 Aug 24 12:36:46.847331 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 243/485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:46 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:46.852927 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:46.855305 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:46.861294 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.861780 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.862214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.862909 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.863363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.863777 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.870588 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:46.879013 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7161e7c0-2c3d-44eb-8097-65b45282c45b tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1750 microversion: 2.1 time: 0.762080 Aug 24 12:36:46.880187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 243/486] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:46 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1750 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:46.885486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:46.886349 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:46.892395 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.893114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.893700 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.894551 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:46.895179 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:46.895969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:46.896723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lazy-loading 'flavor' on Instance uuid 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:47.035174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-34f7872c-cca8-4c17-b3d9-e56341b532de tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/action" status: 200 len: 32 microversion: 2.1 time: 0.186660 Aug 24 12:36:47.036030 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 244/487] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:36:46 2022] POST /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:36:47.053503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:47.054528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:47.062295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.062770 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.063232 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:47.064132 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.064732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.065291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:47.212680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:47.222156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1d39bd4d-beeb-4012-b441-ecb31b672e95 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1678 microversion: 2.1 time: 0.340434 Aug 24 12:36:47.222853 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 244/488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:46 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1678 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:47.341567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:47.353429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-caa51ea7-766a-4b39-9ff5-6b0f9d2d69d2 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.306202 Aug 24 12:36:47.354292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 245/489] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:47 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:47.793633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-5c4c1303-fa8e-444d-9fda-c56c087d6ab4 req-417a1a66-3add-4b56-bb81-202e60227be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d90b9b-40b9-4bdd-981a-cd8c18281f3a", "name": "network-vif-deleted", "tag": "d973b062-e8ab-4ee5-836a-848846c35103"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:47.805069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5c4c1303-fa8e-444d-9fda-c56c087d6ab4 req-417a1a66-3add-4b56-bb81-202e60227be7 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.805578 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5c4c1303-fa8e-444d-9fda-c56c087d6ab4 req-417a1a66-3add-4b56-bb81-202e60227be7 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.806709 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5c4c1303-fa8e-444d-9fda-c56c087d6ab4 req-417a1a66-3add-4b56-bb81-202e60227be7 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:47.819135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-5c4c1303-fa8e-444d-9fda-c56c087d6ab4 req-417a1a66-3add-4b56-bb81-202e60227be7 service nova] Creating event network-vif-deleted:d973b062-e8ab-4ee5-836a-848846c35103 for instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a on hv-cinder-84605 Aug 24 12:36:47.824236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-5c4c1303-fa8e-444d-9fda-c56c087d6ab4 req-417a1a66-3add-4b56-bb81-202e60227be7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Aug 24 12:36:47.824747 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 245/490] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:47.869115 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:47.870089 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:47.876483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.877010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.877442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:47.878169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.878617 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.879037 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:47.901632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:47.902326 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:47.912205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.912734 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.913172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:47.913873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:47.914324 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:47.914747 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:48.075464 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:48.083367 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fd0f15e6-13c0-4786-bcbb-fe05d10f7b28 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.219707 Aug 24 12:36:48.084001 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 246/491] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:47 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:48.113702 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:48.122149 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-db2a65d0-386c-489e-864b-5fa2d8b434ba tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.224735 Aug 24 12:36:48.122803 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 246/492] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:47 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:48.244258 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:48.244906 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:48.251799 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:48.252528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:48.253166 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:48.253904 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:48.254359 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:48.254781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:48.259862 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:48.321585 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:48.329988 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-712c540e-d9f8-4313-aeea-df8cfa6fe5dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1611 microversion: 2.1 time: 0.090344 Aug 24 12:36:48.330565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 247/493] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:48 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:48.376983 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:48.377605 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:48.385231 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:48.385728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:48.386168 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:48.386875 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:48.387325 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:48.387744 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:48.529116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:48.538042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-caec1f1c-7e27-473f-acbf-ce939a6c28e7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.164929 Aug 24 12:36:48.538726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 247/494] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:48 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:49.107395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:49.108095 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:49.114533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.115024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.115577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.116360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.116858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.117285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.143645 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:49.144334 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:49.151010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.151487 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.151912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.152604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.153108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.153459 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.308612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:49.319100 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-099e8811-6766-488d-865e-607596053d5f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.217506 Aug 24 12:36:49.319990 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 248/495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:49 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:49.352107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:49.352277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:49.352805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:49.358961 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.359374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.359805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.360543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.360688 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c1861c05-1f0c-4382-99d9-f8f3de72b70f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.220721 Aug 24 12:36:49.361032 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.361300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 248/496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:49 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:49.373120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.438873 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:49.448990 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-55f7324a-11fb-48e9-8ad8-ecb95d602a6b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1611 microversion: 2.1 time: 0.101274 Aug 24 12:36:49.450295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 249/497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:49 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1611 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:49.560184 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:49.560800 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:49.568039 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.568583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.569209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.569918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:49.570397 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:49.570802 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:49.707992 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:49.716973 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e085f628-db04-4c1a-b0a5-b6ee99bcb40b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.160623 Aug 24 12:36:49.717722 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 249/498] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:49 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:50.341321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:50.342110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:50.349552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.350039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.350474 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.351159 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.351614 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.352034 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.382494 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:50.383274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:50.391120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.391945 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.392472 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.393203 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.393861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.394330 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.592489 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:50.600272 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a2be1560-26a3-4f23-8373-080ea6e50fcb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1679 microversion: 2.1 time: 0.263031 Aug 24 12:36:50.600934 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 250/499] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:50 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:50.605399 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:50.605995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:50.611813 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.612513 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.613129 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.613979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.614637 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.615125 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.638662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:50.651811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2b3973e4-99ba-4641-b53b-32829fbf7b02 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.273163 Aug 24 12:36:50.664391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 250/500] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:50 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:50.718635 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:50.733109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ff2a04a8-f05d-4b1e-bd3e-5882b38dc7c4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 200 len: 1324 microversion: 2.1 time: 0.130580 Aug 24 12:36:50.733436 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 251/501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:50 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 1324 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:50.739162 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1868137187", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "networks": [{"uuid": "9b2a6781-39af-4f3c-89e6-6410bfa1c349"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:50.739346 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:50.739867 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:50.747255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.747780 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.748219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.749238 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:50.749774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:50.750205 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:50.805795 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] validate_networks() for [('9b2a6781-39af-4f3c-89e6-6410bfa1c349', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:36:50.995665 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:51.004711 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2585d511-a554-435c-a515-aeed47a6780a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.269909 Aug 24 12:36:51.005302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 252/502] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:50 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:51.315169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:36:51.315592 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:36:51.316063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:36:51.316465 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:36:51.316897 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:36:51.327746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.328502 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.328611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.329396 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.329851 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.330267 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.348449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Getting quotas for project e3e2e4f6da374afba391fec0fa0bb3fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:36:51.352617 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Getting quotas for user 35d65aef527d421c979e400774fc3fee and project e3e2e4f6da374afba391fec0fa0bb3fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:36:51.370792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:36:51.374828 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:36:51.434200 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-908b4084-2002-4f96-81a0-9e10f49f94df tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698862 Aug 24 12:36:51.434807 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 251/503] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:36:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:36:51.446410 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f3c7a617-3924-48d7-8945-01facbe1a162 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:51.447021 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f3c7a617-3924-48d7-8945-01facbe1a162 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:51.501605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f3c7a617-3924-48d7-8945-01facbe1a162 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:51.508594 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f3c7a617-3924-48d7-8945-01facbe1a162 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1219 microversion: 2.1 time: 0.066730 Aug 24 12:36:51.509431 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 253/504] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:51 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:51.623205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:51.623816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:51.629975 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.630534 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.630982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.631822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.632275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.632711 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.679852 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:51.680467 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:51.687559 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.687954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.688586 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.689437 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.689873 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.690295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.892402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:51.900983 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fbb33bec-5ac4-4a86-9c34-d2f25a42a4d6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1656 microversion: 2.1 time: 0.282667 Aug 24 12:36:51.901659 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 252/505] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:51 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1656 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:51.906495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:51.907179 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:51.919608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.920908 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.921451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.922230 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.922931 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.923396 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.942580 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a HTTP/1.1 Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:36:51.944836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:36:51.946380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': 'd1d90b9b-40b9-4bdd-981a-cd8c18281f3a'} Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:36:51.947246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:36:51.948631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:36:51.949904 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:36:51.949904 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f9ce61b6-f55f-4aec-892f-aff13aa91476 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 404 len: 111 microversion: 2.1 time: 0.045878 Aug 24 12:36:51.950446 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 253/506] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:51 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:36:51.956202 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f1165db0-693d-41d1-8647-00d168fdb8c5 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:51.965941 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1165db0-693d-41d1-8647-00d168fdb8c5 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:51.966437 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1165db0-693d-41d1-8647-00d168fdb8c5 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:51.966877 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1165db0-693d-41d1-8647-00d168fdb8c5 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:51.991282 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:51.993087 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f1165db0-693d-41d1-8647-00d168fdb8c5 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Going to try to start instance {{(pid=127298) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 12:36:52.002521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f3d9a436-cc39-4b5d-9031-b09487f955aa tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.330850 Aug 24 12:36:52.005740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 254/507] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:51 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:52.011230 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6fc804ff-c9fd-4ae5-a466-44cc9c749a5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '.version_select at 0x7fa676e70310>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:52.033393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6fc804ff-c9fd-4ae5-a466-44cc9c749a5b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54204028" status: 202 len: 0 microversion: 2.1 time: 0.026320 Aug 24 12:36:52.034111 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 255/508] 10.222.0.27 () {58 vars in 1215 bytes} [Wed Aug 24 12:36:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54204028 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:52.050978 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:52.052075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:52.061009 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:52.061767 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:52.062413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:52.063419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:52.064119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:52.065289 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:52.067223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f1165db0-693d-41d1-8647-00d168fdb8c5 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.114682 Aug 24 12:36:52.071106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 254/509] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:36:51 2022] POST /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:52.080043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:52.080785 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:52.089672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:52.090181 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:52.090623 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:52.091390 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:52.091850 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:52.092271 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:52.424070 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:52.429988 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:52.432934 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3a28c643-4d3c-45f9-a578-c27922fa951f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1665 microversion: 2.1 time: 0.360012 Aug 24 12:36:52.433665 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 255/510] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:52 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1665 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:52.439804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1f28126a-5809-44c3-8c65-29e124b7d6ef tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.404039 Aug 24 12:36:52.440523 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 256/511] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:52 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:52.529439 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:52.530107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:52.536721 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:52.537169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:52.538254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:52.539461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:52.539461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:52.539974 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:52.935470 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:52.943901 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-52ff9bda-14d8-482b-aa94-4310304cd066 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1271 microversion: 2.1 time: 0.418389 Aug 24 12:36:52.944486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 256/512] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:52 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1271 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:53.023844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:53.024440 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:53.031033 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:53.031519 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:53.031953 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:53.032681 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:53.033785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:53.033785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:53.455007 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:53.455458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:53.461713 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:53.462195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:53.462637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:53.463337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:53.463793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:53.464461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:53.485010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:53.604456 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:53.613153 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-13e8bd97-b882-45c4-a9a5-3e1eb1cdc6fe tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.593483 Aug 24 12:36:53.613733 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 257/513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:53 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:53.618221 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:53.618812 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:53.625048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:53.629268 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:53.629812 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:53.631056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:53.631056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:53.632134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.001411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:54.011010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6dd63de4-b919-4e9f-942e-be46ef7e908d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1665 microversion: 2.1 time: 0.560108 Aug 24 12:36:54.011591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 257/514] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:53 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1665 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:54.019666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:54.019666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:54.024034 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.024529 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.025004 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.026423 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.027379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.027379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.104343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:54.113139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-09684aad-1bd1-472d-b541-2e0f113d6563 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.498372 Aug 24 12:36:54.113719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 258/515] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:53 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:54.118801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:54.119296 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:54.125510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.125992 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.126410 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.127214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.127678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.128092 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.139147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:54.148263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fec164b8-b676-4081-ba21-512b5d041bfe tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1277 microversion: 2.1 time: 0.135478 Aug 24 12:36:54.149265 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 258/516] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:54 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:54.267970 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lazy-loading 'services' on Instance uuid 056ae6fc-add8-4682-ad3d-ab4072db60f5 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:36:54.385553 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6646a27e-1af6-4fb4-99f5-88e37b66ff3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments/4ff155a9-a517-4c4e-9863-d537b84f522b" status: 202 len: 0 microversion: 2.1 time: 0.270357 Aug 24 12:36:54.386549 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 259/517] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:36:54 2022] DELETE /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments/4ff155a9-a517-4c4e-9863-d537b84f522b => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:36:54.395920 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:54.399387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:54.406349 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.406967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.407466 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.408551 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.409335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.410061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.445078 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-23ce5e09-9faa-465d-9968-258af6207a6c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053451 Aug 24 12:36:54.446548 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 259/518] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:36:54 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:54.635372 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:54.636064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:54.643483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.643967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.644404 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.645139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:54.645585 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:54.646056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:54.793538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:54.807212 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3874674d-6e06-4008-969e-08e225873f6e tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.175941 Aug 24 12:36:54.808087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 260/519] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:54 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:55.033098 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:55.033718 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:55.040803 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.041231 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.041664 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.042346 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.042796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.043215 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.134695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:55.135307 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:55.142265 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.142759 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.143195 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.143885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.144334 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.144773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.249496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:55.259122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5074e4b2-7c07-4336-91bb-3b9d8a6e4561 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1665 microversion: 2.1 time: 0.229479 Aug 24 12:36:55.260097 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 260/520] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:55 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1665 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:55.266360 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:55.267003 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:55.268872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:55.274913 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.275401 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.275839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.276540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.277115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.277410 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.417750 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:55.426151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a0242120-2919-43e6-a38e-b34d1385fc0f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.295465 Aug 24 12:36:55.426689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 261/521] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:55 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:55.458119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:55.460613 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:55.466756 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.467228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.467625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.468412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.468857 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.469385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.501704 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-25c1a676-588c-4042-90a7-c727bd5ca56b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047576 Aug 24 12:36:55.502292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 262/522] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:36:55 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:36:55.802081 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:55.812089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-899ca2be-93f5-47c6-b67b-2b9af7d1bd6c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.550039 Aug 24 12:36:55.812694 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 261/523] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:55 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:55.834164 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:55.835233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:55.841413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.841894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.842323 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:55.843018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:55.843464 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:55.843977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.068773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:56.077174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6c0782fc-b8d5-405a-9475-fbce508f45cd tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.247750 Aug 24 12:36:56.077754 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 263/524] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:55 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:56.286341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:56.287912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:56.300222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.301011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.301663 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.302641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.305200 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.306505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.316102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-4ff041c7-dd89-4f67-b5b4-523fb7d5f1e7 req-676db628-721e-4dcb-a01d-09d1cd11db56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bea2c88-0623-4a67-8a07-2e6d61caaa2e", "tag": "222229e0-1805-4804-989e-1e1f6b20f485"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:36:56.337533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4ff041c7-dd89-4f67-b5b4-523fb7d5f1e7 req-676db628-721e-4dcb-a01d-09d1cd11db56 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.338433 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4ff041c7-dd89-4f67-b5b4-523fb7d5f1e7 req-676db628-721e-4dcb-a01d-09d1cd11db56 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.339169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4ff041c7-dd89-4f67-b5b4-523fb7d5f1e7 req-676db628-721e-4dcb-a01d-09d1cd11db56 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.352307 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-4ff041c7-dd89-4f67-b5b4-523fb7d5f1e7 req-676db628-721e-4dcb-a01d-09d1cd11db56 service nova] Creating event network-changed:222229e0-1805-4804-989e-1e1f6b20f485 for instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e on hv-cinder-84605 Aug 24 12:36:56.357144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-4ff041c7-dd89-4f67-b5b4-523fb7d5f1e7 req-676db628-721e-4dcb-a01d-09d1cd11db56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046934 Aug 24 12:36:56.357839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 264/525] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:36:56.448696 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:56.449512 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:56.456080 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.456544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.457016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.457716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.458466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.459324 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.542453 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:56.550646 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-54c3c914-5e6b-4e5e-8033-c71328abab27 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1669 microversion: 2.1 time: 0.269784 Aug 24 12:36:56.551242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 262/526] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:56 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:56.557041 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:56.559496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:56.566149 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.566649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.567082 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.568012 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.568567 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.569053 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.598786 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-435646b1-aca8-4e6d-8974-e54eec46b0b0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046513 Aug 24 12:36:56.599479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 263/527] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:36:56 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:36:56.661737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:56.662282 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:56.668176 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.668673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.669117 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.669796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.670244 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.670661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.696051 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:36:56.705606 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:56.709146 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:36:56.716581 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-781749ea-f421-4324-9e16-fb814b4f4e1d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.272109 Aug 24 12:36:56.717156 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 265/528] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:56 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:56.780537 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6d05982e-ba2e-4ac3-b9e6-0475c7e167ab tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 204 len: 0 microversion: 2.1 time: 0.122411 Aug 24 12:36:56.781477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 264/529] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:36:56 2022] DELETE /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:36:56.790050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:56.790674 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:56.797376 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.797859 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.798291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.798977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.799427 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.799848 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.836417 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:56.837466 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:56.845847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.846607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.847225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.848275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:56.849231 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:56.849885 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:56.997290 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:57.005387 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-28f56976-9ee8-4e5a-b732-34a66cfd6840 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1680 microversion: 2.1 time: 0.219298 Aug 24 12:36:57.006024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 266/530] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:56 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:57.021187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:57.034622 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-79b848bf-f078-4bae-b8da-67e6c3a79763 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.203896 Aug 24 12:36:57.035708 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 265/531] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:56 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:57.100816 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:57.101419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:57.107784 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:57.108257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:57.108688 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:57.109398 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:57.109840 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:57.110252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:57.269082 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:57.277839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1bc8dde9-9a39-4b62-b197-14846bc9572d tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.181330 Aug 24 12:36:57.278408 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 267/532] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:57 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:57.741294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:57.741868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:57.748771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:57.749289 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:57.749723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:57.750413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:57.750866 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:57.751285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:57.901845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:57.910370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4ea234d2-8fc9-4be6-bcc1-b61c6dcbc374 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.174666 Aug 24 12:36:57.910941 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 266/533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:57 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:58.026938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:58.027442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:58.034483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.034961 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.035391 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.036078 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.036919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.037101 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.063859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:58.064469 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:58.071043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.071517 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.071960 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.072693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.073140 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.073558 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.222919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:58.231099 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-dd785e1b-e487-4607-9119-f5fc075d0d70 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1680 microversion: 2.1 time: 0.208120 Aug 24 12:36:58.231675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 268/534] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:58 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:58.250232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:58.258246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a101a5c3-ee98-441f-a27b-c61669a77e5f tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.198327 Aug 24 12:36:58.258816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 267/535] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:58 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:58.299658 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:58.300254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:58.307141 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.307620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.308048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.308763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.309259 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.309680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.498154 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:58.508912 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-df1908b5-af3e-4481-99eb-957372ba0941 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1755 microversion: 2.1 time: 0.213281 Aug 24 12:36:58.509495 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 269/536] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:58 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:58.932987 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:58.933601 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:58.941346 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.942147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.942909 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:58.944099 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:58.944840 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:58.945554 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.081742 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:59.090266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5bcbca51-d13f-43df-97f5-afbba25c9016 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.161652 Aug 24 12:36:59.090815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 268/537] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:58 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:59.253271 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:59.254365 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:59.263552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.264052 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.264499 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.265527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.265986 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.266510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.279693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:59.280300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:59.286384 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.286836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.287296 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.287961 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.288403 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.288844 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.479094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:59.483402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:59.487308 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-84f452f1-dd25-481c-9a91-a9761a093f03 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1680 microversion: 2.1 time: 0.238021 Aug 24 12:36:59.487886 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 270/538] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:59 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:36:59.491778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-985a4d95-05c3-47b7-b503-71ec7b9919f3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.216177 Aug 24 12:36:59.492486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 269/539] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:59 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:36:59.530652 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:36:59.531187 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:36:59.538475 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.538962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.539398 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.540104 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:36:59.540544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:36:59.540996 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:36:59.690364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:36:59.699219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e3943628-6720-482c-bcb2-ff380304c05c tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1758 microversion: 2.1 time: 0.172562 Aug 24 12:36:59.699807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 271/540] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:36:59 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:00.115418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:00.116377 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:00.127259 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.128064 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.128885 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.130099 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.130548 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.130977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.285647 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:00.293977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a60bcbe2-1f69-4d96-b7ca-275101132326 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.185082 Aug 24 12:37:00.294560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 270/541] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:00 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:00.509058 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:00.509687 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:00.511675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:00.512293 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:00.516918 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.517508 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.517981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.518489 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.518712 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.518973 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.519101 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.519423 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.519528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.520122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:00.520682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:00.521146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:00.809308 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:00.817311 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3a928317-070c-46b0-9b75-1c3bc2576fe3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.309427 Aug 24 12:37:00.818075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 271/542] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:00 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:00.856110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:00.864418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-de01f0c4-2748-4adb-a507-e7309d6a773d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1680 microversion: 2.1 time: 0.359455 Aug 24 12:37:00.865060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 272/543] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:00 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1680 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:01.315786 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:01.316327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:01.323233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.323722 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.324571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.324866 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.325321 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.325744 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.342373 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:01.348608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:01.363479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:01.634249 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:01.642768 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-38ac94e0-830b-43a3-89ea-adbd5195ae83 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.331059 Aug 24 12:37:01.643444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 272/544] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:01 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:01.838602 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:01.839292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:01.841228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:01.847785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.848267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.848812 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.849680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.850329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.850824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.886315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:01.886914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:01.892978 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.893460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.893890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.894576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:01.895024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:01.895635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:01.972023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:01.980670 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2522cf30-4f81-4434-a123-5304e8c669bb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 200 len: 1613 microversion: 2.1 time: 0.098041 Aug 24 12:37:01.981459 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 273/545] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:01 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:02.065867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-66b1e265-4a77-4e5b-b94d-0cde7240b952 req-e94d4387-c53b-4056-b788-793886586ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056ae6fc-add8-4682-ad3d-ab4072db60f5", "name": "network-vif-deleted", "tag": "238da6cc-198a-4e0a-9122-8d7624a1ce5d"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:02.076121 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-66b1e265-4a77-4e5b-b94d-0cde7240b952 req-e94d4387-c53b-4056-b788-793886586ac6 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:02.077096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-66b1e265-4a77-4e5b-b94d-0cde7240b952 req-e94d4387-c53b-4056-b788-793886586ac6 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:02.077707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-66b1e265-4a77-4e5b-b94d-0cde7240b952 req-e94d4387-c53b-4056-b788-793886586ac6 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:02.081185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:02.093550 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-66b1e265-4a77-4e5b-b94d-0cde7240b952 req-e94d4387-c53b-4056-b788-793886586ac6 service nova] Creating event network-vif-deleted:238da6cc-198a-4e0a-9122-8d7624a1ce5d for instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 on hv-cinder-84605 Aug 24 12:37:02.098024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bb96a93c-9e39-41f8-80e7-1f516ba4fbf5 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.263116 Aug 24 12:37:02.099917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 273/546] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:01 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:02.113356 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-66b1e265-4a77-4e5b-b94d-0cde7240b952 req-e94d4387-c53b-4056-b788-793886586ac6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038003 Aug 24 12:37:02.114418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 274/547] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:37:02.665675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:02.666622 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:02.674774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:02.675333 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:02.675904 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:02.676841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:02.677499 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:02.678570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:02.819142 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:02.828476 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-88d79892-cfe8-4435-bce5-5ed2904cfe9f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.168141 Aug 24 12:37:02.837138 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 274/548] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:02 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:03.003603 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:03.004289 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:03.011143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.015139 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.015694 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.016671 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.017310 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.018479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.034561 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 HTTP/1.1 Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:37:03.036341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:37:03.037765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '056ae6fc-add8-4682-ad3d-ab4072db60f5'} Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:03.038508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:37:03.039957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:03.041368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:03.041368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e57f7609-df0d-4aa4-bb14-4a626c3743a4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 404 len: 111 microversion: 2.1 time: 0.039577 Aug 24 12:37:03.042465 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 275/549] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:02 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:03.047252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7bdaeb09-fb47-4fc5-8f0a-65d2b90d2361 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '.version_select at 0x7fa676d23dc0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:03.067494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7bdaeb09-fb47-4fc5-8f0a-65d2b90d2361 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702239500" status: 202 len: 0 microversion: 2.1 time: 0.023921 Aug 24 12:37:03.068454 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 275/550] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 12:37:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702239500 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:37:03.120146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:03.121222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:03.127440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.128007 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.128447 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.129176 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.129742 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.130382 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.578664 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:03.586873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2117f9ee-6c26-4400-9481-2f41818a2788 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.470437 Aug 24 12:37:03.591602 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 276/551] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:03 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:03.850365 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:03.851107 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:03.857420 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.857999 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.858430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:03.859119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:03.859563 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:03.859976 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:04.002203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:04.010673 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e0a47c60-b187-463c-a819-a275011f3743 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.164783 Aug 24 12:37:04.011276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 276/552] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:03 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:04.051371 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6644b32c-3c53-4368-afcd-53881b56099c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: .version_select at 0x7fa676d25af0>, body: {"keypair": {"name": "tempest-keypair-1000498158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/KQoq8ZhxTOwza1d/uONLVp9plMRaA8jj7fnlKdvdkInK5Vu+ifU5/FJycfQWH7jntX0RQZFKuXzn7l605eDJaNmmV2GFQEJhbZBygJLaoE5BD18pqTcQGWJrf1x9BA=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:04.068148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-6644b32c-3c53-4368-afcd-53881b56099c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for project 75590a43f50b48699fc0d5a892a99544. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:04.072240 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-6644b32c-3c53-4368-afcd-53881b56099c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for user b4a617fc13534a89ad50a5fdc7bf769a and project 75590a43f50b48699fc0d5a892a99544. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:04.096269 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6644b32c-3c53-4368-afcd-53881b56099c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048760 Aug 24 12:37:04.096905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 277/553] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:37:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:04.609858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:04.610382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:04.617138 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:04.617895 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:04.618325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:04.619733 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:04.620379 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:04.620841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:04.700789 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-128b0574-25d0-4715-ac18-5f7f6cabdfea req-0d2b4ad9-3ecb-4b2a-81d7-d8c78d37de86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bea2c88-0623-4a67-8a07-2e6d61caaa2e", "name": "network-vif-plugged", "status": "completed", "tag": "222229e0-1805-4804-989e-1e1f6b20f485"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:04.714590 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-128b0574-25d0-4715-ac18-5f7f6cabdfea req-0d2b4ad9-3ecb-4b2a-81d7-d8c78d37de86 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:04.715664 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-128b0574-25d0-4715-ac18-5f7f6cabdfea req-0d2b4ad9-3ecb-4b2a-81d7-d8c78d37de86 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:04.716298 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-128b0574-25d0-4715-ac18-5f7f6cabdfea req-0d2b4ad9-3ecb-4b2a-81d7-d8c78d37de86 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:04.732842 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-128b0574-25d0-4715-ac18-5f7f6cabdfea req-0d2b4ad9-3ecb-4b2a-81d7-d8c78d37de86 service nova] Creating event network-vif-plugged:222229e0-1805-4804-989e-1e1f6b20f485 for instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e on hv-cinder-84605 Aug 24 12:37:04.741282 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-128b0574-25d0-4715-ac18-5f7f6cabdfea req-0d2b4ad9-3ecb-4b2a-81d7-d8c78d37de86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049698 Aug 24 12:37:04.743075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 278/554] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:04.774503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:04.783503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-77b67ea6-2b53-464d-92e2-8b02b4c66aff tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.177584 Aug 24 12:37:04.797336 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 277/555] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:04 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:05.035625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:05.036888 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:05.043262 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:05.043762 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:05.044201 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:05.044931 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:05.045392 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:05.045819 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:05.185156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:05.193501 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-594b52ab-1577-4f7a-8cd4-dfb4ca56f193 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.162201 Aug 24 12:37:05.194051 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 279/556] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:05 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:05.447751 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2088630140", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bd462f6-55a5-43db-8eee-5cc12a9f44b1"}], "security_groups": [{"name": "tempest-securitygroup--955450185"}], "key_name": "tempest-keypair-1000498158", "user_data": "}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:05.563544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] validate_networks() for [('3bd462f6-55a5-43db-8eee-5cc12a9f44b1', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:37:05.806035 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:05.806640 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:05.813261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:05.813748 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:05.814185 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:05.814883 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:05.815340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:05.815769 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:06.013086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:37:06.013515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:37:06.013964 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:37:06.014368 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:37:06.014805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:37:06.024388 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:06.025420 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:06.025908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:06.026331 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:06.027060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:06.027512 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:06.027931 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:06.032083 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3b614cb3-d0cb-467e-8047-6020e49cfcb0 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1319 microversion: 2.1 time: 0.230979 Aug 24 12:37:06.040701 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 280/557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:05 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:06.047575 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for project 75590a43f50b48699fc0d5a892a99544. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:06.048913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:06.053419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for user b4a617fc13534a89ad50a5fdc7bf769a and project 75590a43f50b48699fc0d5a892a99544. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:06.065728 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:37:06.068133 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:37:06.115539 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-eb8ac59b-9c6c-42b5-a5c1-67b77d8efb67 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.673676 Aug 24 12:37:06.116161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 278/558] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:37:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:37:06.127408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7729ee06-9f6b-4c60-b28e-02b3db4fbe51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:06.128015 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7729ee06-9f6b-4c60-b28e-02b3db4fbe51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:06.187429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7729ee06-9f6b-4c60-b28e-02b3db4fbe51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:06.195259 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7729ee06-9f6b-4c60-b28e-02b3db4fbe51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1242 microversion: 2.1 time: 0.071640 Aug 24 12:37:06.196597 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 281/559] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:06 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:06.214916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:06.215718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:06.222209 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:06.222692 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:06.223149 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:06.224226 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:06.224531 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:06.225035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:06.376466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:06.385348 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2edea3db-00c9-4653-a10d-6420581961b4 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.174300 Aug 24 12:37:06.385887 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 279/560] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:06 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:07.056621 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:07.057517 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:07.066320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.066913 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.067422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.068139 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.068587 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.069037 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.214725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:07.217888 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:07.218497 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:07.222707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f8d91b0b-c7ea-4123-a530-bfb0ae91b553 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1507 microversion: 2.1 time: 0.173237 Aug 24 12:37:07.223298 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 282/561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:07 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:07.225088 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.225570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.226003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.226727 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.227171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.227803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.243148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cb501ea-197d-4f2f-8ea9-402aa625fab7", "device": "/dev/sdb"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:07.245596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:07.251665 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.252142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.252569 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.253282 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.253723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.254163 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.289967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:07.298087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fc11d81d-43e0-4e68-ae45-7c1e4896622e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1294 microversion: 2.1 time: 0.084054 Aug 24 12:37:07.298655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 280/562] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:07 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:07.411011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:07.412286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:07.421808 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.422549 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.423219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.424269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:07.425070 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:07.425726 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:07.576520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:07.585462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b9f3912a-b9d2-4f9b-ace4-673b7043963f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.180701 Aug 24 12:37:07.586026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 281/563] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:07 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:08.320810 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:08.321469 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.328293 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.328776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.329193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.329889 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.330344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.330769 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.391891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:08.399977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-478d292e-2f98-4c4f-a839-c3b436450d01 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1294 microversion: 2.1 time: 0.084208 Aug 24 12:37:08.400540 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 282/564] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:08 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:08.607916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:08.609797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:08.616141 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.616915 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.617745 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.618644 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:08.619329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:08.620120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:08.719514 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c4f32763-2598-4feb-bdea-6a5a3f8452d1 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "POST /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.480341 Aug 24 12:37:08.725476 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 283/565] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:37:07 2022] POST /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e/os-volume_attachments => generated 194 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:08.759333 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:08.767520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7a1476b8-3f3f-4dbb-b148-40440f433a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.163904 Aug 24 12:37:08.768082 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 283/566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:08 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:09.428153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:09.428916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:09.436342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.436865 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.437301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.437988 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.438438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.438857 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.505448 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:09.516775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-62c5e0d1-83f0-4f6b-8faa-b4c39714fc2f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1300 microversion: 2.1 time: 0.094489 Aug 24 12:37:09.517614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 284/567] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:09 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:09.789295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:09.789977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:09.796838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.797332 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.797768 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.798470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:09.798931 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:09.799390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:09.804612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:10.003744 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:10.012419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-50e4b983-f89b-4c5c-9c15-b4794c804e81 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1736 microversion: 2.1 time: 0.227834 Aug 24 12:37:10.013250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 284/568] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:09 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:10.539769 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:10.540364 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:10.549736 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.550485 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.550882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.551658 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:10.552212 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:10.552636 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:10.688916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:10.697118 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6ca94c1c-54a9-4c6d-ae26-0c1db741f24e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.162374 Aug 24 12:37:10.697934 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 285/569] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:10 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:11.034102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:11.034849 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:11.043200 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.043832 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.044372 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.045378 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.046541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.046853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.270659 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:11.280254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-eb10167f-ae22-4155-9a92-3877988b1294 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1716 microversion: 2.1 time: 0.249779 Aug 24 12:37:11.281176 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 285/570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:11 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1716 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:11.371109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-950df016-f751-4f86-a91e-b30ce34c4ee2 req-cb754282-29f7-458b-ab4a-9bb584ffc053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e224a672-083c-40d5-a171-d4d92b90ee52", "tag": "5115a01a-8526-49be-a576-d36b19e4542c"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:11.382700 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-950df016-f751-4f86-a91e-b30ce34c4ee2 req-cb754282-29f7-458b-ab4a-9bb584ffc053 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.383589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-950df016-f751-4f86-a91e-b30ce34c4ee2 req-cb754282-29f7-458b-ab4a-9bb584ffc053 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.384104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-950df016-f751-4f86-a91e-b30ce34c4ee2 req-cb754282-29f7-458b-ab4a-9bb584ffc053 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.402853 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-950df016-f751-4f86-a91e-b30ce34c4ee2 req-cb754282-29f7-458b-ab4a-9bb584ffc053 service nova] Creating event network-changed:5115a01a-8526-49be-a576-d36b19e4542c for instance e224a672-083c-40d5-a171-d4d92b90ee52 on hv-cinder-84605 Aug 24 12:37:11.406852 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:11.407344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:11.407971 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-950df016-f751-4f86-a91e-b30ce34c4ee2 req-cb754282-29f7-458b-ab4a-9bb584ffc053 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040690 Aug 24 12:37:11.409159 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 286/571] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:11.414587 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.415791 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.416109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.416801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.417247 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.417662 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.501387 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] HTTP exception thrown: Cannot 'detach_volume' instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 while it is in vm_state rescued Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Request method failure captured: Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments/81aeefe5-5eb5-40e7-971d-a71289131ebc HTTP/1.1 Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp5kFLOwMoQfDuoqV9OaiK27E3R7iCj1fFESiH9PZCFXQFTab8fK-2w8Bs8_TMr_SLLsSiPZ4ZwQW6ZNcR_qqKoizjITLf3aHbmVnciBlzkKvnBeBZAqhV0hF3FMuMygkwYRZece1uvcRkCz7ssTDpdPE-epN1q1H3jWavzuwztb7I Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:37:11.503027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}] Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: e34cbcf69b4b4828a3bca077fc8d0694 Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:37:11.504807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Cannot 'detach_volume' instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 while it is in vm_state rescued Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'server_id': '92266f2b-5066-4d2e-b0a0-49f3ac0e3510', 'id': '81aeefe5-5eb5-40e7-971d-a71289131ebc'} Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:11.505580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 while it is in vm_state rescued Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 while it is in vm_state rescued Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:11.507010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Returning 409 to user: Cannot 'detach_volume' instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 while it is in vm_state rescued {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:11.508224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c5c9fefa-ee7f-4e5b-b177-c7e5acb23961 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments/81aeefe5-5eb5-40e7-971d-a71289131ebc" status: 409 len: 152 microversion: 2.1 time: 0.102784 Aug 24 12:37:11.508224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 286/572] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:37:11 2022] DELETE /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments/81aeefe5-5eb5-40e7-971d-a71289131ebc => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 12:37:11.514257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:11.514881 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:11.521276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.521767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.522199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.522893 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.523342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.523767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.594925 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a4f1d32f-57cf-4cb3-baeb-b6eaf5941791 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "POST /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/action" status: 202 len: 0 microversion: 2.1 time: 0.084621 Aug 24 12:37:11.599008 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 287/573] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:37:11 2022] POST /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:37:11.604623 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:11.613167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:11.620165 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.620676 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.621119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.621818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.622295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.622714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.719295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:11.720111 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:11.727964 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.728452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.728928 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:11.730325 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:11.730791 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:11.731230 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:12.002719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:12.011754 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e9f27de7-5b77-4159-983a-e1635445e09a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1724 microversion: 2.1 time: 0.410978 Aug 24 12:37:12.024673 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 287/574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:11 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:12.082526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:12.090461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a1be6e3e-aa26-44f8-a05f-dde31cafde41 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.375777 Aug 24 12:37:12.091235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 288/575] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:11 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:13.033642 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:13.034257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:13.041251 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.041744 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.042176 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.043101 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.043888 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.044631 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.112476 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:13.113106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:13.120160 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.120700 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.121111 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.121811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:13.122269 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:13.122682 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:13.232677 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:13.241506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b6f28337-cb2b-467a-9a51-bbed1216f10e tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1724 microversion: 2.1 time: 0.211812 Aug 24 12:37:13.242103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 288/576] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:13 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:13.279177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:13.290865 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f445c3f8-05cc-4312-813b-8e4466479946 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.181657 Aug 24 12:37:13.292316 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 289/577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:13 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:14.262871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:14.263487 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:14.270723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.271211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.271649 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.272332 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.272825 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.273251 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.317503 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:14.318109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:14.324978 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.325463 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.325888 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.326601 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:14.327032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:14.327447 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:14.477998 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:14.486964 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1d3e234a-3ac5-4a25-ba05-6ab5a7c3d2d0 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1724 microversion: 2.1 time: 0.227900 Aug 24 12:37:14.487490 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 289/578] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:14 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:14.504135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:14.512761 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6303ad06-46a2-4c0e-9b4a-2709d04d0483 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.199279 Aug 24 12:37:14.513549 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 290/579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:14 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:15.513474 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:15.514470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:15.523527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.524003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.524430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.525177 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.525624 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.526036 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.534266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:15.534846 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:15.542250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.542712 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.543177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.543863 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:15.544317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:15.544775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:15.563732 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:15.729155 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:15.733206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:15.737760 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8051ab69-6b7a-49bc-84fd-1fd7f13832b6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1724 microversion: 2.1 time: 0.231120 Aug 24 12:37:15.738353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 290/580] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:15 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:15.741216 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2474aa18-4b11-415a-9823-1326bb80be10 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.210702 Aug 24 12:37:15.741762 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 291/581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:15 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:16.706961 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-7640ae08-083d-48a8-b531-5cdecee63a87 req-c216a272-4399-4b94-8f31-cb224763a7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e224a672-083c-40d5-a171-d4d92b90ee52", "name": "network-vif-plugged", "status": "completed", "tag": "5115a01a-8526-49be-a576-d36b19e4542c"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:16.711955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:16.712694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=6 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:16.722551 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-7640ae08-083d-48a8-b531-5cdecee63a87 req-c216a272-4399-4b94-8f31-cb224763a7a3 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:16.723196 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-7640ae08-083d-48a8-b531-5cdecee63a87 req-c216a272-4399-4b94-8f31-cb224763a7a3 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:16.723776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-7640ae08-083d-48a8-b531-5cdecee63a87 req-c216a272-4399-4b94-8f31-cb224763a7a3 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.735162 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-7640ae08-083d-48a8-b531-5cdecee63a87 req-c216a272-4399-4b94-8f31-cb224763a7a3 service nova] Creating event network-vif-plugged:5115a01a-8526-49be-a576-d36b19e4542c for instance e224a672-083c-40d5-a171-d4d92b90ee52 on hv-cinder-84605 Aug 24 12:37:16.740729 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-7640ae08-083d-48a8-b531-5cdecee63a87 req-c216a272-4399-4b94-8f31-cb224763a7a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037729 Aug 24 12:37:16.741320 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 291/582] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:16.759403 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:16.760047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:16.762141 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:16.762490 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:16.763155 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:16.769225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:16.770825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:16.770966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:16.771260 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.771369 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:16.771760 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.772304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:16.772457 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:16.772934 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:16.773113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:16.773354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.773537 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:16.970394 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:16.974616 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:16.978905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b128db08-2c25-419c-ae45-008112d75a71 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1730 microversion: 2.1 time: 0.223635 Aug 24 12:37:16.979493 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 292/583] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:16 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:16.983325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e5ad9d24-d9fc-4449-9159-59cf7e5ab065 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.225050 Aug 24 12:37:16.984233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 292/584] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:16 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:17.000059 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:17.000553 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:17.006795 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:17.007275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:17.007709 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:17.008396 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:17.008927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:17.009350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:17.088200 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9f1ba5c9-155a-4fad-943a-67a979828461 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091897 Aug 24 12:37:17.088796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 293/585] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 12:37:16 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:18.004985 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:18.005601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:18.012499 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.013017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.013445 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:18.014143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.014599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.015002 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:18.232762 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:18.247146 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5b80e5a3-800c-401c-ab6f-f643dbf1a186 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.245522 Aug 24 12:37:18.247846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 293/586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:17 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:18.252628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-ddd5391f-af4f-48f1-af38-7631260c9959 req-45dcf3d6-a8a6-403e-b91e-bd534eb76d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92266f2b-5066-4d2e-b0a0-49f3ac0e3510", "tag": "8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:18.263850 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ddd5391f-af4f-48f1-af38-7631260c9959 req-45dcf3d6-a8a6-403e-b91e-bd534eb76d1a service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:18.265430 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ddd5391f-af4f-48f1-af38-7631260c9959 req-45dcf3d6-a8a6-403e-b91e-bd534eb76d1a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:18.266105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ddd5391f-af4f-48f1-af38-7631260c9959 req-45dcf3d6-a8a6-403e-b91e-bd534eb76d1a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:18.278380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-ddd5391f-af4f-48f1-af38-7631260c9959 req-45dcf3d6-a8a6-403e-b91e-bd534eb76d1a service nova] Creating event network-changed:8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b for instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 on hv-cinder-84605 Aug 24 12:37:18.283267 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-ddd5391f-af4f-48f1-af38-7631260c9959 req-45dcf3d6-a8a6-403e-b91e-bd534eb76d1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035846 Aug 24 12:37:18.283870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 294/587] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:19.274866 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:19.275481 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:19.282757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.283237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.283659 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.284342 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:19.284822 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:19.285215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:19.425803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:19.434152 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-dd961daa-694f-4bee-8672-3a69f574e43e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.163483 Aug 24 12:37:19.434718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 294/588] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:19 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:20.307162 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-befadbfc-0faa-46aa-94b8-b73a062c5df3 req-3689b52e-58ce-4de8-92a0-dc6d67a376de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92266f2b-5066-4d2e-b0a0-49f3ac0e3510", "tag": "8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:20.320608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-befadbfc-0faa-46aa-94b8-b73a062c5df3 req-3689b52e-58ce-4de8-92a0-dc6d67a376de service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.321117 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-befadbfc-0faa-46aa-94b8-b73a062c5df3 req-3689b52e-58ce-4de8-92a0-dc6d67a376de service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.321545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-befadbfc-0faa-46aa-94b8-b73a062c5df3 req-3689b52e-58ce-4de8-92a0-dc6d67a376de service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.333452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-befadbfc-0faa-46aa-94b8-b73a062c5df3 req-3689b52e-58ce-4de8-92a0-dc6d67a376de service nova] Creating event network-changed:8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b for instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 on hv-cinder-84605 Aug 24 12:37:20.338381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-befadbfc-0faa-46aa-94b8-b73a062c5df3 req-3689b52e-58ce-4de8-92a0-dc6d67a376de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039463 Aug 24 12:37:20.338969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 295/589] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:20.455774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:20.456397 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:20.464002 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.464488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.464958 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.465660 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:20.466108 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:20.466530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:20.610678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:20.619174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8ad2602f-a32a-4063-a4c4-c60cd0d96afd tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.167316 Aug 24 12:37:20.619730 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 295/590] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:20 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:21.643599 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:21.644387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:21.651242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:21.651726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:21.652160 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.652890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:21.653344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:21.653767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:21.795732 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:21.808093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ee1758d0-5ec7-4ac7-a91d-18774b2add1a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.172021 Aug 24 12:37:21.808823 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 296/591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:21 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:22.033283 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:22.034445 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:22.042418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.043279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.043894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.044616 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.045103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.045522 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.086656 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3c7daeb4-b443-4eba-b8d8-7083a48eb580 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments/e28fadc9-0292-4025-9f53-f96259945a38" status: 200 len: 194 microversion: 2.20 time: 0.057291 Aug 24 12:37:22.087292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 296/592] 10.222.0.27 () {60 vars in 1454 bytes} [Wed Aug 24 12:37:22 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments/e28fadc9-0292-4025-9f53-f96259945a38 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:22.174689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:22.174689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:22.183910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.184426 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.184882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.185590 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.186043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.186518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.289549 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lazy-loading 'services' on Instance uuid 6ac6a7ad-e418-48a8-8e4b-a1449c35183a {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:22.377120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-efb1de13-6fa7-4178-a8b3-adb1f849d14e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments/e28fadc9-0292-4025-9f53-f96259945a38" status: 202 len: 0 microversion: 2.20 time: 0.205974 Aug 24 12:37:22.378112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 297/593] 10.222.0.27 () {60 vars in 1457 bytes} [Wed Aug 24 12:37:22 2022] DELETE /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments/e28fadc9-0292-4025-9f53-f96259945a38 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:22.389077 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:22.391375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:22.399403 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.399936 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.400361 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.401477 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.402210 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.402840 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.439197 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bdb39e84-5271-4fc0-a692-46d36fdce2b8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055536 Aug 24 12:37:22.439748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 297/594] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:22 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:22.833874 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:22.834784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:22.841625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.842106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.842720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:22.843429 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:22.843948 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:22.844721 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.042608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:23.053593 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9b6600bc-8809-4014-b714-b2bbe7dd7ada tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1367 microversion: 2.1 time: 0.222935 Aug 24 12:37:23.054211 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 298/595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:22 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:23.454314 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:23.456797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:23.464256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.464844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.465338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.466132 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:23.466652 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:23.467130 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:23.497726 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-cdfeabf1-ca46-4869-a52e-731f3ce5b60b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048765 Aug 24 12:37:23.498282 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 298/596] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:23 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:24.077830 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:24.078871 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:24.095612 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.096427 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.097251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.098063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.098626 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.099056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.229962 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:24.238611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6c4b32c8-d12e-42a7-a420-5e58c6cd0975 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1556 microversion: 2.1 time: 0.167268 Aug 24 12:37:24.239188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 299/597] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:24 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:24.264563 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:24.265079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:24.271524 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.272024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.272476 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.273211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.273654 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.274098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.357472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1df748cf-90bc-44ba-8ee6-4944c5fad066 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096810 Aug 24 12:37:24.358114 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 299/598] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 12:37:24 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:24.510581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:24.513032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:24.520714 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.521192 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.521705 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.522452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:24.522920 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:24.523314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:24.560057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0f53d572-63bb-405c-8d0d-429dc227c74f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053479 Aug 24 12:37:24.564698 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 300/599] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:24 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:25.298102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-4a1f7d0c-472d-418e-b40f-177c6ac8c85a req-59f3e559-a97c-47ee-a1eb-0889fb2b6053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e224a672-083c-40d5-a171-d4d92b90ee52", "tag": "5115a01a-8526-49be-a576-d36b19e4542c"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:25.308448 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4a1f7d0c-472d-418e-b40f-177c6ac8c85a req-59f3e559-a97c-47ee-a1eb-0889fb2b6053 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.308947 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4a1f7d0c-472d-418e-b40f-177c6ac8c85a req-59f3e559-a97c-47ee-a1eb-0889fb2b6053 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.309369 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4a1f7d0c-472d-418e-b40f-177c6ac8c85a req-59f3e559-a97c-47ee-a1eb-0889fb2b6053 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.321284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-4a1f7d0c-472d-418e-b40f-177c6ac8c85a req-59f3e559-a97c-47ee-a1eb-0889fb2b6053 service nova] Creating event network-changed:5115a01a-8526-49be-a576-d36b19e4542c for instance e224a672-083c-40d5-a171-d4d92b90ee52 on hv-cinder-84605 Aug 24 12:37:25.326219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-4a1f7d0c-472d-418e-b40f-177c6ac8c85a req-59f3e559-a97c-47ee-a1eb-0889fb2b6053 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032233 Aug 24 12:37:25.326783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 300/600] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:25.572347 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:25.574646 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:25.578313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:25.582673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.583259 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.583720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.584422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:25.585103 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:25.585555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:25.620069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e4022395-3a75-4208-9a9c-cfb9aef20886 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051799 Aug 24 12:37:25.620691 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 301/601] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:25 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:26.635289 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:26.637986 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:26.646322 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:26.646806 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:26.647246 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:26.647967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:26.648421 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:26.648878 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:26.679688 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a4d964a1-d888-4b1e-a77e-219644266970 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049912 Aug 24 12:37:26.680313 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 301/602] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:26 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 12:37:27.691853 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:27.694004 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:27.700661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.701149 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.701571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.702251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.702695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.703105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.731666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-eacba3e6-2f10-4a5e-904d-8d68b1dc4c07 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043926 Aug 24 12:37:27.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 302/603] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 12:37:27 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:27.797182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:27.798157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:27.809019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.809812 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.810530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.811640 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.812341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.813123 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.832721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:27.840851 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Going to try to terminate instance {{(pid=127299) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:27.929492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-de1952e9-0a73-4e6f-be7a-2541bb75fb8b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 204 len: 0 microversion: 2.20 time: 0.138432 Aug 24 12:37:27.930364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 302/604] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 24 12:37:27 2022] DELETE /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:37:27.938790 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:27.939411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:27.945893 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.946370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.946800 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:27.947478 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:27.947935 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:27.948361 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:28.093909 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:28.103462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:28.105067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:28.106221 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4463ffbe-9082-47cb-a4d2-4f4b68b0b924 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.171401 Aug 24 12:37:28.106823 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 303/605] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:27 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:29.134791 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:29.135923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:29.145905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.146383 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.146807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.147488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:29.147939 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:29.148353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:29.296133 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:29.305255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:29.306781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:29.307912 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-be7e388b-68d1-46c1-aca7-36d3262c8eb2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.180742 Aug 24 12:37:29.308472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 303/606] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:29 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:30.330851 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:30.331492 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:30.338750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.339449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.339866 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.340586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.341074 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.341496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.373545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:30.374183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:30.380876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.381359 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.381784 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.382476 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:30.382918 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:30.383331 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:30.474453 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lazy-loading 'services' on Instance uuid 3bea2c88-0623-4a67-8a07-2e6d61caaa2e {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:30.548262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-24a99b29-25ae-468d-b89d-4acba1a60b0a tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e/os-volume_attachments/2cb501ea-197d-4f2f-8ea9-402aa625fab7" status: 202 len: 0 microversion: 2.1 time: 0.178992 Aug 24 12:37:30.549093 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 304/607] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:37:30 2022] DELETE /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e/os-volume_attachments/2cb501ea-197d-4f2f-8ea9-402aa625fab7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:30.560996 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:30.571957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:30.573552 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:30.575566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bfebc6ae-23f5-42b4-8615-1cc7024bf378 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1723 microversion: 2.20 time: 0.248167 Aug 24 12:37:30.578088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 304/608] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:30 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:31.461304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-cbc50e41-f1f3-4d8c-bfbb-4c08c99f07ad req-ba61c527-1f17-4399-9ccd-0112cfa82d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac6a7ad-e418-48a8-8e4b-a1449c35183a", "name": "network-vif-deleted", "tag": "2846875a-a14c-495e-a9aa-ea984a5071c2"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:31.473159 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-cbc50e41-f1f3-4d8c-bfbb-4c08c99f07ad req-ba61c527-1f17-4399-9ccd-0112cfa82d10 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.473644 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-cbc50e41-f1f3-4d8c-bfbb-4c08c99f07ad req-ba61c527-1f17-4399-9ccd-0112cfa82d10 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.474056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-cbc50e41-f1f3-4d8c-bfbb-4c08c99f07ad req-ba61c527-1f17-4399-9ccd-0112cfa82d10 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.486260 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-cbc50e41-f1f3-4d8c-bfbb-4c08c99f07ad req-ba61c527-1f17-4399-9ccd-0112cfa82d10 service nova] Creating event network-vif-deleted:2846875a-a14c-495e-a9aa-ea984a5071c2 for instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a on hv-cinder-84605 Aug 24 12:37:31.491626 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-cbc50e41-f1f3-4d8c-bfbb-4c08c99f07ad req-ba61c527-1f17-4399-9ccd-0112cfa82d10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035071 Aug 24 12:37:31.492718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 305/609] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:31.598228 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:31.599535 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:31.606523 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.607243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.607855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.608747 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.609347 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.609915 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.710003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:31.710597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:31.718321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.718818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.719277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.719976 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.720430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.720886 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.724075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:31.738280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:31.742598 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:31.745808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f25b6312-d566-4825-88dc-d103dc47c8e9 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1367 microversion: 2.20 time: 0.150857 Aug 24 12:37:31.746746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 305/610] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:31 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:31.755153 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Going to try to terminate instance {{(pid=127299) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:31.845346 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-acac8671-16a4-4096-8a95-bb56b2d47b00 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 204 len: 0 microversion: 2.1 time: 0.139423 Aug 24 12:37:31.845944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 306/611] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:31 2022] DELETE /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:31.854291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:31.854901 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:31.861463 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.861953 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.862446 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:31.863300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:31.863753 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:31.864172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.000251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:32.008153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2bb8e18e-5e04-4516-bb04-6960f71b5544 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1513 microversion: 2.1 time: 0.157775 Aug 24 12:37:32.008940 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 306/612] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:31 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:32.772913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:32.773573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:32.780573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.781113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.781567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.782287 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.782759 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.783197 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.818046 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:32.818517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:32.818946 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:32.819391 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lazy-loading 'fault' on Instance uuid 6ac6a7ad-e418-48a8-8e4b-a1449c35183a {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:32.862461 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:32.870817 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:32.872304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:32.873555 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-845681cc-67dd-4fd9-8053-9b39aec4180c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1372 microversion: 2.20 time: 0.105941 Aug 24 12:37:32.874112 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 307/613] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:32 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:33.030533 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:33.031075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:33.038236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.038722 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.039156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.039849 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.040306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.040787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.174587 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:33.183778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3074c2e4-e84f-4ccd-9b2f-62fa42017f4c tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1513 microversion: 2.1 time: 0.157235 Aug 24 12:37:33.184356 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 307/614] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:33 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:33.896444 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:33.897306 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:33.904388 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.904931 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.905488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.906307 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.906923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.907510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.940482 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:33.941035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:33.941645 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:33.942110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lazy-loading 'fault' on Instance uuid 6ac6a7ad-e418-48a8-8e4b-a1449c35183a {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:33.989300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:33.998831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:34.000598 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:34.001771 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-008ca9fc-94f5-4ba3-8025-4bf3fb68d0ae tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 200 len: 1372 microversion: 2.20 time: 0.109945 Aug 24 12:37:34.002328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 308/615] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:33 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:34.208684 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:34.209281 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:34.216364 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.216882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.217348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.218107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.218585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.219032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.352824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:34.361021 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-74c95404-db33-4b82-b777-a34c9b139aa6 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1513 microversion: 2.1 time: 0.158299 Aug 24 12:37:34.361603 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 308/616] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:34 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:34.942896 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-35783640-c971-4753-be74-e9d086199962 req-78e27218-0ae6-479a-a970-ab1cd1394a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bea2c88-0623-4a67-8a07-2e6d61caaa2e", "name": "network-vif-deleted", "tag": "222229e0-1805-4804-989e-1e1f6b20f485"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:34.954489 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-35783640-c971-4753-be74-e9d086199962 req-78e27218-0ae6-479a-a970-ab1cd1394a08 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:34.954960 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-35783640-c971-4753-be74-e9d086199962 req-78e27218-0ae6-479a-a970-ab1cd1394a08 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:34.955375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-35783640-c971-4753-be74-e9d086199962 req-78e27218-0ae6-479a-a970-ab1cd1394a08 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:34.968151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-35783640-c971-4753-be74-e9d086199962 req-78e27218-0ae6-479a-a970-ab1cd1394a08 service nova] Creating event network-vif-deleted:222229e0-1805-4804-989e-1e1f6b20f485 for instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e on hv-cinder-84605 Aug 24 12:37:34.974257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-35783640-c971-4753-be74-e9d086199962 req-78e27218-0ae6-479a-a970-ab1cd1394a08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035584 Aug 24 12:37:34.974859 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 309/617] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:35.023662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:35.024261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:35.030215 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.030690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.031117 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.031822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.032245 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.032679 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.036695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:35.047576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] HTTP exception thrown: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Request method failure captured: Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a HTTP/1.1 Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhrHpfZ5WvZXf5iogDbpOHllFPK_nl2GSk9Y_O6lwhFUQJWkkwIJtZotiTD-6Lqwb_7PokyWW8Egyga_3YX7JgQLKK-Bpdj4YaAiZQUmGgt998AT29k9IQv_ktDRQBJudZlPtLPM1DQtM6Fibq6Fe4Ms00Dj_KHLMLpsJTfj6m193ik Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:37:35.049486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}] Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: fd39206c155f4e1cb9f7f90fb5a10556 Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:37:35.052344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '6ac6a7ad-e418-48a8-8e4b-a1449c35183a'} Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:35.053303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:37:35.054540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:35.055850 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Returning 404 to user: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:35.055850 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-61f46648-e05a-4208-b845-c753abf9a806 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 404 len: 111 microversion: 2.20 time: 0.031561 Aug 24 12:37:35.055850 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 309/618] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:35 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:37:35.061615 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7b8d3360-fcc9-4aaf-8e14-a5d2781a1081 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '.version_select at 0x7fa676d2f280>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:35.080748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7b8d3360-fcc9-4aaf-8e14-a5d2781a1081 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024908009" status: 204 len: 0 microversion: 2.20 time: 0.023359 Aug 24 12:37:35.081453 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 310/619] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Aug 24 12:37:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024908009 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:37:35.382831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:35.383522 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:35.390766 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.391318 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.391813 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.392570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.393110 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.393741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.427438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:35.428382 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:35.428879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:35.429347 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lazy-loading 'fault' on Instance uuid 3bea2c88-0623-4a67-8a07-2e6d61caaa2e {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:35.481535 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d65aef527d421c979e400774fc3fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2e4f6da374afba391fec0fa0bb3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:35.491571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9f2f97f4-f92e-496f-be58-92a03774dac7 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 200 len: 1309 microversion: 2.1 time: 0.112580 Aug 24 12:37:35.492173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 310/620] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:35 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:35.760168 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-4c826b0d-6c05-40c8-8a59-124011fb5156 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'create', calling method: .version_select at 0x7fa676d23f70>, body: {"keypair": {"name": "tempest-keypair-1314085783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKl0TP1xjBFk7Yo+0Qazlz3ogLUeKWk3wpKCK1rBaiZCwIAx8mAs+m9WC1SW3kEZO6Us7/UPeu95i8iuB8C7jyLhDbkBTUuvbr2I0gZvUDXYJMcGr5EPVCeqNmXS/6UK9Q=="}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:35.776612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-4c826b0d-6c05-40c8-8a59-124011fb5156 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Getting quotas for project 9095a2f3c7d946a2b017115364dc6753. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:35.780786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-4c826b0d-6c05-40c8-8a59-124011fb5156 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Getting quotas for user fd39206c155f4e1cb9f7f90fb5a10556 and project 9095a2f3c7d946a2b017115364dc6753. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:35.789517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:35.808192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-4c826b0d-6c05-40c8-8a59-124011fb5156 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052175 Aug 24 12:37:35.808816 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 311/621] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Aug 24 12:37:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 12:37:36.512882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:36.513479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] [instance: 3bea2c88-0623-4a67-8a07-2e6d61caaa2e] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:36.520240 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.520757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.521187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.521883 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:36.522335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:36.522757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:36.536547 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] HTTP exception thrown: Instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e could not be found. Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Request method failure captured: Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e HTTP/1.1 Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhr6zdDU-6fR4OINSpO__82za3Dt25Jw3WmlNDX5rmjf89WN1xvk5wY4RSVbENSn6CBnZwixIqW_JZQgBRGbn7CZYSHES4c_lmQCzKh2WyzY5bzCIvubNVfnNcbhF4YzKuJq8kkddi78mFwv8S5Ruklyzczvq-D3Q9bk_A9pnhBTmsg Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: e3e2e4f6da374afba391fec0fa0bb3fb Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1904912420 Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:37:36.538115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3e2e4f6da374afba391fec0fa0bb3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3e2e4f6da374afba391fec0fa0bb3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3e2e4f6da374afba391fec0fa0bb3fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3e2e4f6da374afba391fec0fa0bb3fb"}]}] Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesSnapshotTestJSON-1904912420 Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: e3e2e4f6da374afba391fec0fa0bb3fb Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1904912420 Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesSnapshotTestJSON-1904912420-project Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 35d65aef527d421c979e400774fc3fee Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesSnapshotTestJSON-1904912420-project Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e could not be found. Aug 24 12:37:36.539672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '3bea2c88-0623-4a67-8a07-2e6d61caaa2e'} Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e could not be found. Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:36.540530 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e could not be found. Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e could not be found. Aug 24 12:37:36.541985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:37:36.543255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] Returning 404 to user: Instance 3bea2c88-0623-4a67-8a07-2e6d61caaa2e could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:36.543255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fa1bf572-2a12-45d9-9abe-a3d279fb8bc3 tempest-VolumesSnapshotTestJSON-1904912420 tempest-VolumesSnapshotTestJSON-1904912420-project] 10.222.0.27 "GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e" status: 404 len: 111 microversion: 2.1 time: 0.030677 Aug 24 12:37:36.543456 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 311/622] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:36 2022] GET /compute/v2.1/servers/3bea2c88-0623-4a67-8a07-2e6d61caaa2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:37.160035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2117729481", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d6c857e-b67a-49a9-87ca-af5b474759f7"}], "security_groups": [{"name": "tempest-securitygroup--1158991486"}], "key_name": "tempest-keypair-1314085783", "user_data": "}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:37.273784 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] validate_networks() for [('4d6c857e-b67a-49a9-87ca-af5b474759f7', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:37:37.679458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:37:37.680077 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:37:37.680807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:37:37.681407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:37:37.682020 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:37:37.694629 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.695115 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.695550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.696278 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:37.696770 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:37.697182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:37.714400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Getting quotas for project 9095a2f3c7d946a2b017115364dc6753. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:37.718597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Getting quotas for user fd39206c155f4e1cb9f7f90fb5a10556 and project 9095a2f3c7d946a2b017115364dc6753. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:37.730034 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:37:37.732403 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:37:37.787276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6e52daf1-9207-45a4-a912-3ad22c9fe0fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.632475 Aug 24 12:37:37.787910 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 312/623] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Aug 24 12:37:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 12:37:37.798626 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b2a085f9-ada7-4298-80ad-d3a3cccf37b4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:37.799206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b2a085f9-ada7-4298-80ad-d3a3cccf37b4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:37.855893 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b2a085f9-ada7-4298-80ad-d3a3cccf37b4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:37.863560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b2a085f9-ada7-4298-80ad-d3a3cccf37b4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:37.865072 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b2a085f9-ada7-4298-80ad-d3a3cccf37b4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:37.866633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b2a085f9-ada7-4298-80ad-d3a3cccf37b4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1282 microversion: 2.20 time: 0.071954 Aug 24 12:37:37.867350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 312/624] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:37 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:38.890400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:38.890978 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:38.897881 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:38.898382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:38.898795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:38.899480 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:38.899931 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:38.900348 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:39.025602 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:39.037032 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:39.038545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:39.039649 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-472b205a-876a-446a-a409-9b0cbbc6ce76 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1278 microversion: 2.20 time: 0.153803 Aug 24 12:37:39.040208 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 313/625] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:38 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:40.065323 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:40.065972 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:40.073744 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.074222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.074627 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.075341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:40.075795 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:40.076214 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:40.195384 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:40.203783 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:40.205281 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:40.206518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e38cb584-961e-4193-aa06-025b11695ab6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1278 microversion: 2.20 time: 0.147255 Aug 24 12:37:40.207060 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 313/626] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:40 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:41.229151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:41.229756 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:41.236783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:41.237403 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:41.237808 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:41.238525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:41.238972 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:41.239374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:41.304311 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:41.312994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:41.314477 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:41.315858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3c1c4f7e-6b37-4b49-ba48-bcd49457170f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1334 microversion: 2.20 time: 0.090701 Aug 24 12:37:41.316410 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 314/627] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:41 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:42.338750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:42.340061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:42.350689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.351238 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.351732 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.352734 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:42.353190 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:42.353606 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:42.583063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:42.603855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:42.605680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:42.606809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ae61aa40-0b9e-4aac-850f-88d02325b6a3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.272387 Aug 24 12:37:42.607362 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 314/628] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:42 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:43.039616 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-f326deb6-3ef6-44ad-95fd-264001a1e2bb req-70567ca8-5941-4787-bf2d-dd8e34a7cc53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8", "tag": "da3fa7cd-644d-43c9-a049-2c30fdb50dce"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:43.051175 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f326deb6-3ef6-44ad-95fd-264001a1e2bb req-70567ca8-5941-4787-bf2d-dd8e34a7cc53 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.051625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f326deb6-3ef6-44ad-95fd-264001a1e2bb req-70567ca8-5941-4787-bf2d-dd8e34a7cc53 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.052131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f326deb6-3ef6-44ad-95fd-264001a1e2bb req-70567ca8-5941-4787-bf2d-dd8e34a7cc53 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.063722 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-f326deb6-3ef6-44ad-95fd-264001a1e2bb req-70567ca8-5941-4787-bf2d-dd8e34a7cc53 service nova] Creating event network-changed:da3fa7cd-644d-43c9-a049-2c30fdb50dce for instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 on hv-cinder-84605 Aug 24 12:37:43.068753 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-f326deb6-3ef6-44ad-95fd-264001a1e2bb req-70567ca8-5941-4787-bf2d-dd8e34a7cc53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032820 Aug 24 12:37:43.069338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 315/629] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:43.631113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:43.631902 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:43.639116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.639959 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.640519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.641358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:43.641916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:43.642432 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:43.885637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:43.894161 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:43.896314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:43.897472 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-86576d0c-e59d-40fc-8f63-def92391cd20 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.270455 Aug 24 12:37:43.898113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 315/630] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:43 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:44.928971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:44.929657 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:44.936318 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.936965 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.937494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.938263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.938795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.939216 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.984455 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:44.987518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:44.993995 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.994462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.995172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:44.995594 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:44.996043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:44.996463 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.028728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-087eed6b-fa1e-4fec-91bf-3094de90a2bb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048040 Aug 24 12:37:45.034982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 316/631] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:44 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:37:45.105186 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:45.105582 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:45.112545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.113050 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.113683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.114482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.114940 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.115364 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.124922 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:45.135649 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:45.138199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:45.139478 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-27db6c73-dab1-4475-b9c0-e9619bf5d330 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.215651 Aug 24 12:37:45.152673 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 316/632] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:44 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:45.161379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:45.272374 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6159e446-a319-4394-a45b-7b5522a1ee95 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 204 len: 0 microversion: 2.1 time: 0.170990 Aug 24 12:37:45.273379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 317/633] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:45 2022] DELETE /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:37:45.281922 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:45.282525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:45.289203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.289787 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.290234 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.290969 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:45.291660 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:45.292112 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:45.437351 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:45.448382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f12cb357-251d-4d76-a8e4-1f480252fad7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1675 microversion: 2.1 time: 0.170469 Aug 24 12:37:45.449099 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 317/634] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:45 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:37:46.174339 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:46.175109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:46.182667 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.183170 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.183623 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.184336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.184835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.185277 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.323513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:46.333317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:46.335055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:46.336250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a760c466-82e6-4e02-94ca-433314c2e324 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.169446 Aug 24 12:37:46.336858 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 318/635] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:46 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:46.471874 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:46.472492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:46.479094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.479576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.480008 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.480725 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:46.481178 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:46.481601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:46.621651 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:46.631566 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-11c0a928-7e5f-4920-97ba-91714fd712a9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1675 microversion: 2.1 time: 0.163986 Aug 24 12:37:46.632131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 318/636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:46 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:47.360315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:47.361085 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:47.369490 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.370101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.370640 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.371513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.372081 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.372605 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.527423 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:47.538236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:47.539730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:47.540869 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-958b4e65-54e8-4fb2-9cc0-14f75d7465be tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.185402 Aug 24 12:37:47.541440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 319/637] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:47 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:47.657325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:47.658211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:47.669296 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.670102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.670779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.671954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:47.672722 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:47.673439 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:47.678117 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:47.707039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:47.725409 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=10 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:47.809610 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:47.817694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-748074b9-016e-4409-86d7-7c9e0017f2b7 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1675 microversion: 2.1 time: 0.167007 Aug 24 12:37:47.818236 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 319/638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:47 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:48.568042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:48.569043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:48.572047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:48.581546 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.582026 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.582451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.583157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.583604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.584016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.722962 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:48.731241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:48.732809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:48.733864 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e7756b74-ed32-4709-9e99-738e4c762a87 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.172814 Aug 24 12:37:48.734432 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 320/639] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:48 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:48.839786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:48.840389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:48.848164 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.848688 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.849279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:48.850135 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:48.850677 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:48.851119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.081887 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:49.093707 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a4e801ce-3201-4494-850b-0fc13aca8da1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1675 microversion: 2.1 time: 0.257622 Aug 24 12:37:49.094609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 320/640] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:48 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:49.757401 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:49.758092 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:49.765724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:49.766539 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:49.767024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.768140 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:49.769073 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:49.769478 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:49.912585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:49.921361 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:49.922968 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:49.925087 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f1492667-b527-4750-8389-5457615eb2a8 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.172530 Aug 24 12:37:49.926015 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 321/641] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:49 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:50.116079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:50.116676 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:50.126669 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.127236 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.127673 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.128714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.129422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.130038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.329528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:50.338018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9148f1e9-1488-48d1-9347-1cc774909e19 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1675 microversion: 2.1 time: 0.225876 Aug 24 12:37:50.338583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 321/642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:50 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:50.949986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:50.950788 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:50.958692 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.959187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.959623 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:50.960325 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:50.961114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:50.961536 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.194119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:51.202778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:51.204365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:51.206277 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b75f9f02-dc60-42bf-b26e-7b50850b1e2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.261663 Aug 24 12:37:51.206854 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 322/643] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:50 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:37:51.359616 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:51.360989 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:51.368237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.368854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.369299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.370019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.370480 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.370906 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.451264 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:51.460322 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7f0ab141-4b59-4775-8423-65e49cf5242e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 200 len: 1608 microversion: 2.1 time: 0.104769 Aug 24 12:37:51.460951 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 322/644] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:51 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 1608 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:51.799928 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-433cf501-4675-45a2-a9ae-ff355c542df7 req-943488bc-3b7a-4a77-8cf3-33d82bad6d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0c5601-af7b-4464-a37d-63b475832ae5", "name": "network-vif-deleted", "tag": "044abc21-c178-491b-a6ae-f86df02d67c5"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:51.811432 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-433cf501-4675-45a2-a9ae-ff355c542df7 req-943488bc-3b7a-4a77-8cf3-33d82bad6d27 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.812190 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-433cf501-4675-45a2-a9ae-ff355c542df7 req-943488bc-3b7a-4a77-8cf3-33d82bad6d27 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.812798 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-433cf501-4675-45a2-a9ae-ff355c542df7 req-943488bc-3b7a-4a77-8cf3-33d82bad6d27 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.828923 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-433cf501-4675-45a2-a9ae-ff355c542df7 req-943488bc-3b7a-4a77-8cf3-33d82bad6d27 service nova] Creating event network-vif-deleted:044abc21-c178-491b-a6ae-f86df02d67c5 for instance 0c0c5601-af7b-4464-a37d-63b475832ae5 on hv-cinder-84605 Aug 24 12:37:51.841856 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-433cf501-4675-45a2-a9ae-ff355c542df7 req-943488bc-3b7a-4a77-8cf3-33d82bad6d27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045504 Aug 24 12:37:51.846952 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 323/645] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:51.857894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-e4e7d5e1-83fc-4e3c-81b3-77086735d44e req-815e83c4-14bb-4fd0-8278-63ab36800d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8", "name": "network-vif-plugged", "status": "completed", "tag": "da3fa7cd-644d-43c9-a049-2c30fdb50dce"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:51.878306 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-e4e7d5e1-83fc-4e3c-81b3-77086735d44e req-815e83c4-14bb-4fd0-8278-63ab36800d47 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:51.878737 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-e4e7d5e1-83fc-4e3c-81b3-77086735d44e req-815e83c4-14bb-4fd0-8278-63ab36800d47 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:51.879188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-e4e7d5e1-83fc-4e3c-81b3-77086735d44e req-815e83c4-14bb-4fd0-8278-63ab36800d47 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:51.900810 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-e4e7d5e1-83fc-4e3c-81b3-77086735d44e req-815e83c4-14bb-4fd0-8278-63ab36800d47 service nova] Creating event network-vif-plugged:da3fa7cd-644d-43c9-a049-2c30fdb50dce for instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 on hv-cinder-84605 Aug 24 12:37:51.906647 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-e4e7d5e1-83fc-4e3c-81b3-77086735d44e req-815e83c4-14bb-4fd0-8278-63ab36800d47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056737 Aug 24 12:37:51.908980 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 323/646] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:52.193357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2034035103"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:52.193981 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:52.200690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.201199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.201629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.202330 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.202778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.203199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.229978 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:52.230794 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:52.237623 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.238196 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.238724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.239487 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.240739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.241307 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.437886 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.network.security_group_api [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Removing security group 538e2495-21a2-4bf8-9dd0-75ff2fdc3319 from port 84866825-9b5e-4f5b-b6e1-614b038c9651 Aug 24 12:37:52.683877 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:52.693554 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:52.695360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:52.696610 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-32aecc40-0ca5-4ff5-9ec6-b9dd513af9c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.470890 Aug 24 12:37:52.697302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 324/647] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:52 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:52.704937 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:52.705576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:52.711779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.712514 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.712974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.713675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:52.714109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:52.714546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:52.729016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] HTTP exception thrown: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Request method failure captured: Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 HTTP/1.1 Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhpvqu6ZF6PkXWPDcapqqQvdTnqkmK6s_NkUrIk3Kc72IrZCMggWnsIWy115rWAy2HtqmkzDVz2spWheoJgOv2HbH4krQgeCZjl5hkVRLaD1jeJBYAtwnhZraScFr4ViTGE2_OXE3RgIeKfx1RH_KCVVWIHuDRvJd1ggbpvpAF9U1Fo Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:37:52.730694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}] Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 85d8138d44bc40dd8f63ee4916ffbce9 Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:37:52.732220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '0c0c5601-af7b-4464-a37d-63b475832ae5'} Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:52.733060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:37:52.734233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:52.735417 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Returning 404 to user: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:52.735417 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-72d1bd8e-cda9-4cc7-a776-2ce2d16fa737 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 404 len: 111 microversion: 2.1 time: 0.030820 Aug 24 12:37:52.735417 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 325/648] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:52 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:52.741464 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1b398a27-1be7-4958-80d7-e9f68ac466e8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '.version_select at 0x7fa676ceab80>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:52.763291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1b398a27-1be7-4958-80d7-e9f68ac466e8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030226403" status: 202 len: 0 microversion: 2.1 time: 0.025758 Aug 24 12:37:52.765549 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 326/649] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 12:37:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030226403 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:53.073460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-24a55d75-dcd4-414b-bc0d-d700179ce359 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "POST /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.885329 Aug 24 12:37:53.077433 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 324/650] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:37:52 2022] POST /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/action => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:53.572632 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6e2665ef-e4f2-4f21-bd08-94c43e297a1d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'create', calling method: .version_select at 0x7fa676d239d0>, body: {"keypair": {"name": "tempest-keypair-384769707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJVGkXefngZWHkH/bd7b7riquhkejW5QpWq1RTEcP9WaFG4+BEn/09o7ek3j7+vUXafzlftgYV1nhBxLrTxS8KC8LnOteNlRjJS9v0TghZkbHXUTgU/VlrFwKKuzHeSNw=="}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:53.591394 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-6e2665ef-e4f2-4f21-bd08-94c43e297a1d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Getting quotas for project 96fea11cfdd748bab1cdea46b073dc89. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:53.596485 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-6e2665ef-e4f2-4f21-bd08-94c43e297a1d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Getting quotas for user 85d8138d44bc40dd8f63ee4916ffbce9 and project 96fea11cfdd748bab1cdea46b073dc89. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:53.620338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6e2665ef-e4f2-4f21-bd08-94c43e297a1d tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051594 Aug 24 12:37:53.621233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 327/651] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:37:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:53.720012 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:53.720991 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:53.728391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.728915 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.729570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.730308 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.730763 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.731401 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.954355 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-e7590787-07b1-44eb-bdf8-7b28447805a3 req-82a3b720-9854-4832-95e0-21a7a53591b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ca7d79-b522-4650-a770-396d9e60c8d1", "tag": "84866825-9b5e-4f5b-b6e1-614b038c9651"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:53.967837 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-e7590787-07b1-44eb-bdf8-7b28447805a3 req-82a3b720-9854-4832-95e0-21a7a53591b9 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:53.969534 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-e7590787-07b1-44eb-bdf8-7b28447805a3 req-82a3b720-9854-4832-95e0-21a7a53591b9 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:53.970275 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-e7590787-07b1-44eb-bdf8-7b28447805a3 req-82a3b720-9854-4832-95e0-21a7a53591b9 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:53.986761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-e7590787-07b1-44eb-bdf8-7b28447805a3 req-82a3b720-9854-4832-95e0-21a7a53591b9 service nova] Creating event network-changed:84866825-9b5e-4f5b-b6e1-614b038c9651 for instance 17ca7d79-b522-4650-a770-396d9e60c8d1 on hv-cinder-84605 Aug 24 12:37:53.995214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-e7590787-07b1-44eb-bdf8-7b28447805a3 req-82a3b720-9854-4832-95e0-21a7a53591b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045993 Aug 24 12:37:53.997067 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 328/652] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:54.130775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:54.140937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:54.142999 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:54.144425 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cf994472-abef-470a-b2ec-cb5c46eea54b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1408 microversion: 2.20 time: 0.428604 Aug 24 12:37:54.145345 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 325/653] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:53 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1408 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:54.761957 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:54.762996 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:54.771983 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:54.773680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:54.774356 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:54.775266 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:54.776243 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:54.777231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:54.878842 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lazy-loading 'services' on Instance uuid 17ca7d79-b522-4650-a770-396d9e60c8d1 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:37:54.980435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-67a18a7a-4d90-4aa7-82ff-4e5b1b012e38 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments/c3177171-1144-4464-8d7c-ec569b2f8c4c" status: 202 len: 0 microversion: 2.1 time: 0.223118 Aug 24 12:37:54.988376 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 329/654] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:37:54 2022] DELETE /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments/c3177171-1144-4464-8d7c-ec569b2f8c4c => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:37:54.990878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:54.993172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:55.005663 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.007088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.007690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.008695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.009529 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.010187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.050424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1774bcef-7d36-4dd5-89e1-60c2be71dc69 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063191 Aug 24 12:37:55.051321 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 326/655] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:54 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:37:55.168248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:55.169031 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:55.179700 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.180191 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.180854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.181734 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-963676287", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99d8ab94-72d1-43ac-bae0-de280712c5bd"}], "security_groups": [{"name": "tempest-securitygroup--1492210123"}], "key_name": "tempest-keypair-384769707", "user_data": "}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:55.181941 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.182543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.183118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.332636 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] validate_networks() for [('99d8ab94-72d1-43ac-bae0-de280712c5bd', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:37:55.381462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:55.392602 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:55.394557 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:55.395901 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7637c292-7266-4498-a28a-fb117e3d18fb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1599 microversion: 2.20 time: 0.232823 Aug 24 12:37:55.412146 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 330/656] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:37:55 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1599 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:37:55.418836 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:55.418836 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:55.428005 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.428855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.429491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.430379 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.431182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.431793 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.583916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1cdf9bc9-efd2-4733-bb6e-4a8e1632757e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.169935 Aug 24 12:37:55.584991 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 331/657] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Aug 24 12:37:55 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:37:55.643459 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:55.888470 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:37:55.888922 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:37:55.889393 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:37:55.889801 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:37:55.890871 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:37:55.900124 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.900635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.901407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.902137 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:55.902591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:55.903011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:55.910166 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:37:55.923090 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Getting quotas for project 96fea11cfdd748bab1cdea46b073dc89. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:37:55.928334 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Getting quotas for user 85d8138d44bc40dd8f63ee4916ffbce9 and project 96fea11cfdd748bab1cdea46b073dc89. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:37:55.939998 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:37:55.942402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:37:55.993582 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-54661e64-b537-4f3c-a6e6-79cd66e14da8 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.816039 Aug 24 12:37:55.994965 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 327/658] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:37:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:37:56.007738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6c68f969-0743-4c0c-8f20-b263f357008c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:56.008446 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6c68f969-0743-4c0c-8f20-b263f357008c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:56.044108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-cc061862-4e1d-45ed-a24d-067e97ee6d8e req-a6ff87a4-c2d5-4aec-9588-061aa86e0eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ca7d79-b522-4650-a770-396d9e60c8d1", "tag": "84866825-9b5e-4f5b-b6e1-614b038c9651"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:56.064120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-cc061862-4e1d-45ed-a24d-067e97ee6d8e req-a6ff87a4-c2d5-4aec-9588-061aa86e0eff service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.064918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-cc061862-4e1d-45ed-a24d-067e97ee6d8e req-a6ff87a4-c2d5-4aec-9588-061aa86e0eff service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.065527 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-cc061862-4e1d-45ed-a24d-067e97ee6d8e req-a6ff87a4-c2d5-4aec-9588-061aa86e0eff service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.082112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-cc061862-4e1d-45ed-a24d-067e97ee6d8e req-a6ff87a4-c2d5-4aec-9588-061aa86e0eff service nova] Creating event network-changed:84866825-9b5e-4f5b-b6e1-614b038c9651 for instance 17ca7d79-b522-4650-a770-396d9e60c8d1 on hv-cinder-84605 Aug 24 12:37:56.099134 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-cc061862-4e1d-45ed-a24d-067e97ee6d8e req-a6ff87a4-c2d5-4aec-9588-061aa86e0eff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062220 Aug 24 12:37:56.099870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 328/659] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:37:56.113034 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:56.115334 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:56.115494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6c68f969-0743-4c0c-8f20-b263f357008c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:56.123929 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6c68f969-0743-4c0c-8f20-b263f357008c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1236 microversion: 2.1 time: 0.121579 Aug 24 12:37:56.124502 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.125603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 332/660] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:56 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:56.128804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.129701 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.131730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.133193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.134250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.187927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a1c899cf-e111-4149-8885-366060e11834 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086337 Aug 24 12:37:56.190658 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 329/661] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:56 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:56.716584 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-d8fe8910-4fe1-425d-a193-a0400ace2238 req-e6846691-eaad-4980-badf-26e4f4e85201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8", "tag": "da3fa7cd-644d-43c9-a049-2c30fdb50dce"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:37:56.727565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-d8fe8910-4fe1-425d-a193-a0400ace2238 req-e6846691-eaad-4980-badf-26e4f4e85201 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:56.729002 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-d8fe8910-4fe1-425d-a193-a0400ace2238 req-e6846691-eaad-4980-badf-26e4f4e85201 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:56.729570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-d8fe8910-4fe1-425d-a193-a0400ace2238 req-e6846691-eaad-4980-badf-26e4f4e85201 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:56.742579 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-d8fe8910-4fe1-425d-a193-a0400ace2238 req-e6846691-eaad-4980-badf-26e4f4e85201 service nova] Creating event network-changed:da3fa7cd-644d-43c9-a049-2c30fdb50dce for instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 on hv-cinder-84605 Aug 24 12:37:56.748488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-d8fe8910-4fe1-425d-a193-a0400ace2238 req-e6846691-eaad-4980-badf-26e4f4e85201 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035911 Aug 24 12:37:56.750014 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 333/662] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:37:57.147911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:57.148532 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:57.154831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.155574 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.156188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.157171 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.158045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.158767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.202933 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:57.205911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:57.212679 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.213195 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.213628 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.214339 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.214788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.215207 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.248586 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-4a411fe4-9081-4c30-b4e9-8857cf4c7eca tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050327 Aug 24 12:37:57.249454 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 334/663] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:37:57 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:37:57.259693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:57.260966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:57.268164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:57.269879 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.270740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.271375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.272536 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:57.273362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:57.273991 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:57.279783 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-df42b0d7-e8bf-4267-967a-990d33ddd671 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1288 microversion: 2.1 time: 0.137883 Aug 24 12:37:57.280713 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 330/664] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:57 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1288 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:57.386165 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] HTTP exception thrown: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 is not attached to volume c3177171-1144-4464-8d7c-ec569b2f8c4c Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Request method failure captured: Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments/c3177171-1144-4464-8d7c-ec569b2f8c4c HTTP/1.1 Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhriqgehvpO7EkfafKqbNsY_UvuoKM749OYRV2O1HTxhwwtA2SsKgzzF7rOW9UpqrwjNUKFtZzFSkuEf0rZjadbMr-40tGgknpHULMwsJtOTb3VGRrTXt5XviTT9Hk0sRYmQIhdPwgVgoTjI84i_ciFP33G59IcgpRi9kEtH0fjtx-g Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 5dc78d8e41d843a2b085f8300a285a0e Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-TestMinimumBasicScenario-557707283 Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:37:57.389414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dc78d8e41d843a2b085f8300a285a0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dc78d8e41d843a2b085f8300a285a0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dc78d8e41d843a2b085f8300a285a0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dc78d8e41d843a2b085f8300a285a0e"}]}] Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-TestMinimumBasicScenario-557707283 Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 5dc78d8e41d843a2b085f8300a285a0e Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-TestMinimumBasicScenario-557707283 Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-TestMinimumBasicScenario-557707283-project Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 3a145fea1ee64ab18b93f3bf47c3fb65 Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-TestMinimumBasicScenario-557707283-project Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:37:57.391012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 is not attached to volume c3177171-1144-4464-8d7c-ec569b2f8c4c Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'server_id': '17ca7d79-b522-4650-a770-396d9e60c8d1', 'id': 'c3177171-1144-4464-8d7c-ec569b2f8c4c'} Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c3177171-1144-4464-8d7c-ec569b2f8c4c. Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:37:57.391868 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 is not attached to volume c3177171-1144-4464-8d7c-ec569b2f8c4c Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 is not attached to volume c3177171-1144-4464-8d7c-ec569b2f8c4c Aug 24 12:37:57.393407 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:37:57.395401 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Returning 404 to user: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 is not attached to volume c3177171-1144-4464-8d7c-ec569b2f8c4c {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:37:57.396724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a97fc2f6-0f49-4a2b-8ad3-c1c3a7c8ef8f tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments/c3177171-1144-4464-8d7c-ec569b2f8c4c" status: 404 len: 154 microversion: 2.1 time: 0.140714 Aug 24 12:37:57.397760 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 335/665] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:37:57 2022] DELETE /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1/os-volume_attachments/c3177171-1144-4464-8d7c-ec569b2f8c4c => generated 154 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:37:58.309519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:58.310251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:58.317770 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.318271 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.318698 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.319414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.319872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.320295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.560228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:58.560815 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:58.568203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.569085 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.569502 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.570208 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.570636 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.570828 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:58.571252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.580241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d6406617-af46-401e-9a64-6d21fff01fe4 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1294 microversion: 2.1 time: 0.274640 Aug 24 12:37:58.581085 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 331/666] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:58 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1294 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:58.597345 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Going to try to terminate instance {{(pid=127299) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:37:58.692935 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-690228bd-ebf2-4089-ad85-dd70f09ff444 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 204 len: 0 microversion: 2.1 time: 0.135820 Aug 24 12:37:58.694192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 336/667] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:37:58 2022] DELETE /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:37:58.704752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:58.706291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:58.713781 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.714295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.714793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.715573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:58.716406 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:58.717046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:58.854141 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:58.861899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f3de5d8a-3a49-4468-89c1-70b76eb025dc tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1552 microversion: 2.1 time: 0.162776 Aug 24 12:37:58.862477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 332/668] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:58 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:59.603043 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:59.603836 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:59.610372 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.610886 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.611560 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.612349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.612844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.613272 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.752194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:37:59.760530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9d6df842-f41d-4409-bc9e-f1d7196fabec tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.161823 Aug 24 12:37:59.761200 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 337/669] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:59 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:37:59.889069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:37:59.889724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:37:59.899156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.899879 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.900428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:37:59.901500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:37:59.902154 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:37:59.902637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.063456 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:00.071379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fd89628e-4657-4e2d-9d62-33f0ed3d9e01 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1552 microversion: 2.1 time: 0.187133 Aug 24 12:38:00.071965 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 333/670] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:37:59 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:00.783369 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:00.784269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:00.792094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:00.793033 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:00.793518 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:00.794354 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:00.794903 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:00.795437 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.092557 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:01.093860 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:01.101078 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.101567 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.101999 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.102906 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.103355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.103778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.184683 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:01.193716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-86f0b92a-be0e-4f5c-b446-797bdd01b7f1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.415650 Aug 24 12:38:01.194381 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 338/671] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:00 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:01.435754 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a145fea1ee64ab18b93f3bf47c3fb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc78d8e41d843a2b085f8300a285a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:01.444872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c7c9f11c-ccfa-4b67-8a49-d434f9d4ecd3 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 200 len: 1552 microversion: 2.1 time: 0.355958 Aug 24 12:38:01.459783 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 334/672] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:01 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 1552 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:38:01.551042 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-5d518620-f53d-476b-ae1e-159fa776d61a req-e6970387-6a36-4caa-8484-b21d5de4b12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35478048-ed82-46ca-af89-72f4f56abb58", "tag": "4002fdef-db85-47a2-aecc-5abe1e61a01b"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:01.561920 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-5d518620-f53d-476b-ae1e-159fa776d61a req-e6970387-6a36-4caa-8484-b21d5de4b12c service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:01.562781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-5d518620-f53d-476b-ae1e-159fa776d61a req-e6970387-6a36-4caa-8484-b21d5de4b12c service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:01.563263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-5d518620-f53d-476b-ae1e-159fa776d61a req-e6970387-6a36-4caa-8484-b21d5de4b12c service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:01.578865 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-5d518620-f53d-476b-ae1e-159fa776d61a req-e6970387-6a36-4caa-8484-b21d5de4b12c service nova] Creating event network-changed:4002fdef-db85-47a2-aecc-5abe1e61a01b for instance 35478048-ed82-46ca-af89-72f4f56abb58 on hv-cinder-84605 Aug 24 12:38:01.590087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-5d518620-f53d-476b-ae1e-159fa776d61a req-e6970387-6a36-4caa-8484-b21d5de4b12c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059675 Aug 24 12:38:01.591217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 339/673] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:02.214662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:02.215428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:02.222173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.222789 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.223213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.224148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.224857 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.225348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.431022 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:02.440946 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9db94a17-614f-4896-8aca-e3a717af5df1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.230252 Aug 24 12:38:02.442263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 335/674] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:02 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:02.473075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:02.474849 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] [instance: 17ca7d79-b522-4650-a770-396d9e60c8d1] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:02.483246 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.484109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.485978 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.487710 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:02.488565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:02.490012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:02.495485 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:02.507334 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] HTTP exception thrown: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 could not be found. Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Request method failure captured: Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 HTTP/1.1 Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhriqgehvpO7EkfafKqbNsY_UvuoKM749OYRV2O1HTxhwwtA2SsKgzzF7rOW9UpqrwjNUKFtZzFSkuEf0rZjadbMr-40tGgknpHULMwsJtOTb3VGRrTXt5XviTT9Hk0sRYmQIhdPwgVgoTjI84i_ciFP33G59IcgpRi9kEtH0fjtx-g Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 5dc78d8e41d843a2b085f8300a285a0e Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-TestMinimumBasicScenario-557707283 Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:38:02.509097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dc78d8e41d843a2b085f8300a285a0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dc78d8e41d843a2b085f8300a285a0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dc78d8e41d843a2b085f8300a285a0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dc78d8e41d843a2b085f8300a285a0e"}]}] Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-TestMinimumBasicScenario-557707283 Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 5dc78d8e41d843a2b085f8300a285a0e Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-TestMinimumBasicScenario-557707283 Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-TestMinimumBasicScenario-557707283-project Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 3a145fea1ee64ab18b93f3bf47c3fb65 Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-TestMinimumBasicScenario-557707283-project Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 could not be found. Aug 24 12:38:02.510473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '17ca7d79-b522-4650-a770-396d9e60c8d1'} Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 could not be found. Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:02.511167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 could not be found. Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 could not be found. Aug 24 12:38:02.512340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:02.513449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Returning 404 to user: Instance 17ca7d79-b522-4650-a770-396d9e60c8d1 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:02.513449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-84deb6de-7164-45fc-bed0-89acd64a9625 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1" status: 404 len: 111 microversion: 2.1 time: 0.047269 Aug 24 12:38:02.513449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 340/675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:02 2022] GET /compute/v2.1/servers/17ca7d79-b522-4650-a770-396d9e60c8d1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:02.520752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e4ea7266-3f93-4231-8b3d-3702be4ff8f0 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] Calling method '.version_select at 0x7fa676b89f70>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:02.543745 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e4ea7266-3f93-4231-8b3d-3702be4ff8f0 tempest-TestMinimumBasicScenario-557707283 tempest-TestMinimumBasicScenario-557707283-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-534366296" status: 202 len: 0 microversion: 2.1 time: 0.027867 Aug 24 12:38:02.544733 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 336/676] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Aug 24 12:38:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-534366296 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:38:03.462221 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:03.462816 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:03.478152 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.478779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.479077 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.479788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.480240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.480671 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.615680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-13bf90fe-09ed-4b68-a041-84553263ad23 req-f5885d2c-4ae4-4269-a643-6e5c5780fc74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ca7d79-b522-4650-a770-396d9e60c8d1", "name": "network-vif-deleted", "tag": "84866825-9b5e-4f5b-b6e1-614b038c9651"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:03.629909 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-13bf90fe-09ed-4b68-a041-84553263ad23 req-f5885d2c-4ae4-4269-a643-6e5c5780fc74 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:03.630387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-13bf90fe-09ed-4b68-a041-84553263ad23 req-f5885d2c-4ae4-4269-a643-6e5c5780fc74 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:03.630807 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-13bf90fe-09ed-4b68-a041-84553263ad23 req-f5885d2c-4ae4-4269-a643-6e5c5780fc74 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:03.648586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-13bf90fe-09ed-4b68-a041-84553263ad23 req-f5885d2c-4ae4-4269-a643-6e5c5780fc74 service nova] Creating event network-vif-deleted:84866825-9b5e-4f5b-b6e1-614b038c9651 for instance 17ca7d79-b522-4650-a770-396d9e60c8d1 on hv-cinder-84605 Aug 24 12:38:03.656398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-13bf90fe-09ed-4b68-a041-84553263ad23 req-f5885d2c-4ae4-4269-a643-6e5c5780fc74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043312 Aug 24 12:38:03.657304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 337/677] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:03.848403 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:03.856429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-aaa9595a-6967-4c57-8086-007b920ba539 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.398276 Aug 24 12:38:03.857418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 341/678] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:03 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:04.878356 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:04.879051 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:04.885699 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:04.886466 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:04.887078 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:04.887935 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:04.888379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:04.888997 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:05.278378 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:05.287091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e546a1f3-a85b-4a74-a53e-b067a0752eb9 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.413587 Aug 24 12:38:05.291424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 338/679] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:04 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:06.309990 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:06.310600 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:06.312954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=6 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:06.314318 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:06.322689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.323182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.323573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.324491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.324963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.325343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.711561 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:06.720824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-17a8925a-0d3f-4cb7-8367-c86917b2e00c tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.416017 Aug 24 12:38:06.721963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 342/680] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:06 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:06.754765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:06.756115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:06.761654 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:06.762552 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:06.769847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.770573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.771160 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.772017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:06.772612 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:06.773225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:06.883801 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lazy-loading 'services' on Instance uuid 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:38:07.019224 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-71303d8a-b191-4613-aa49-aa24ccb7b7fb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments/81aeefe5-5eb5-40e7-971d-a71289131ebc" status: 202 len: 0 microversion: 2.1 time: 0.265091 Aug 24 12:38:07.024777 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 339/681] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:38:06 2022] DELETE /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments/81aeefe5-5eb5-40e7-971d-a71289131ebc => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:38:07.029955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:07.032352 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:07.043268 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:07.050609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:07.051962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:07.054422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:07.055136 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:07.055730 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:07.109877 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-50f5a43c-82de-4c34-98ae-2a729a267efc tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084105 Aug 24 12:38:07.115570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 343/682] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:07 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:07.746764 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:07.747643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:07.757505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:07.758759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:07.759343 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:07.760636 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:07.761251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:07.761813 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.056953 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:08.065859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-476c0165-0d4e-4276-a39b-1598054287aa tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.323241 Aug 24 12:38:08.067312 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 340/683] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:07 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:08.123556 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:08.129140 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:08.137864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.139214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.139927 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.140776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.142497 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.143043 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.203097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-4ca855fd-f296-4701-9222-9cc4750e1a54 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083189 Aug 24 12:38:08.205216 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 344/684] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:08 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:38:08.324889 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:08.325389 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:08.333470 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.334280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.334899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.339584 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.340917 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.341681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.405137 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:38:08.532004 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bc4ffc99-da09-4996-9406-f0f7633d58d6 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 204 len: 0 microversion: 2.1 time: 0.212390 Aug 24 12:38:08.533325 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 341/685] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:08 2022] DELETE /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:38:08.543715 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:08.545046 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:08.552596 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.553483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.554097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.554977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.555784 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.556366 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.758903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-2ac17f4d-cebb-4ab3-b991-291e86a996bc req-e228fa5f-b1b5-4959-a338-421760101cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35478048-ed82-46ca-af89-72f4f56abb58", "name": "network-vif-plugged", "status": "completed", "tag": "4002fdef-db85-47a2-aecc-5abe1e61a01b"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:08.784261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2ac17f4d-cebb-4ab3-b991-291e86a996bc req-e228fa5f-b1b5-4959-a338-421760101cdb service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:08.785041 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2ac17f4d-cebb-4ab3-b991-291e86a996bc req-e228fa5f-b1b5-4959-a338-421760101cdb service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:08.785765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2ac17f4d-cebb-4ab3-b991-291e86a996bc req-e228fa5f-b1b5-4959-a338-421760101cdb service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:08.807280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-2ac17f4d-cebb-4ab3-b991-291e86a996bc req-e228fa5f-b1b5-4959-a338-421760101cdb service nova] Creating event network-vif-plugged:4002fdef-db85-47a2-aecc-5abe1e61a01b for instance 35478048-ed82-46ca-af89-72f4f56abb58 on hv-cinder-84605 Aug 24 12:38:08.819338 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-2ac17f4d-cebb-4ab3-b991-291e86a996bc req-e228fa5f-b1b5-4959-a338-421760101cdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064484 Aug 24 12:38:08.820689 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 342/686] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:08.832966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:08.845472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c43df85c-ddfd-4922-a641-05c7e17afe9c tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1690 microversion: 2.1 time: 0.307593 Aug 24 12:38:08.846178 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 345/687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:08 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1690 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:09.087762 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:09.088455 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:09.094785 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.095508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.095935 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:09.096628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.097101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.097512 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:09.257490 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:09.268539 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6fc672b7-3dbb-4ddb-a4bc-c9b4b8526366 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.184829 Aug 24 12:38:09.269488 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 343/688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:09 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:09.869601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:09.871435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:09.894143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.894655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.895788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:09.899098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:09.900877 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:09.902654 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:10.223316 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:10.244012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8a3e4964-334b-4a3e-a1be-51a810513e2f tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1690 microversion: 2.1 time: 0.379603 Aug 24 12:38:10.245530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 346/689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:09 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1690 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:10.290299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:10.290912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:10.303365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:10.303862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:10.304292 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:10.305027 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:10.305479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:10.305895 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:10.640015 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:10.651615 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-488d12dc-8233-4506-84c7-3a3c2cec0c04 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.365022 Aug 24 12:38:10.652708 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 344/690] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:10 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:11.269738 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:11.270449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:11.278903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.283318 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.283928 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.284877 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.285479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.290442 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.295031 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:11.424894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:11.425404 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:11.433813 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.434492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.435102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.436132 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.436769 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.437341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.483297 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-cf732435-ff49-4d4c-a6a4-8499958c40ee tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/ips" status: 200 len: 148 microversion: 2.1 time: 0.700423 Aug 24 12:38:11.489757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 347/691] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:38:10 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/ips => generated 148 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:11.672642 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:11.673678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:11.690970 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.691551 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.691983 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.692713 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:11.693157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:11.693738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:11.776632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:11.795571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2ca5ce55-0a20-4ba4-84b8-cc62f179ca23 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1690 microversion: 2.1 time: 0.530035 Aug 24 12:38:11.796996 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 345/692] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:11 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1690 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:12.515171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:12.553858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f628de6d-a7e5-4771-a07d-725b9312cd71 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.885183 Aug 24 12:38:12.573148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 348/693] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:11 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:38:12.823269 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:12.826576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:12.837131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:12.837955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:12.839416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:12.841008 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:12.841993 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:12.842808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.034596 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eca198df-0afe-49c5-bf45-34e8b5e15cef"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:13.039917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:13.052397 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.054119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.055715 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.057184 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.057797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.058392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.350055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:13.359258 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7b4bf6cb-2985-4211-a241-5cc92d1448f7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1690 microversion: 2.1 time: 0.544767 Aug 24 12:38:13.362749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 346/694] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:12 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1690 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:13.587011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:13.587677 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:13.612420 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.612964 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.613411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.614130 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:13.614586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:13.615001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:13.902655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7b93ee9b-3bd9-433e-8ab4-f585be89e6ce tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871987 Aug 24 12:38:13.913085 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 349/695] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:38:13 2022] POST /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:14.146986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:14.157408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8507f780-92a9-4ea3-b0b9-e8d08211f5eb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1362 microversion: 2.1 time: 0.581555 Aug 24 12:38:14.161732 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 347/696] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:13 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1362 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:14.381915 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:14.382731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:14.398120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.403670 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.405449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.417788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.419055 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.421828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.566922 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:14.597292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f5ebb814-e2f4-4a2b-84dd-960d8853e495 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 200 len: 1622 microversion: 2.1 time: 0.216000 Aug 24 12:38:14.600261 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 350/697] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:14 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 1622 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:38:14.713566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-9dd88b41-159e-402b-83d9-d978e633908b req-e333ac3c-6fc2-42d4-b0ef-4aa18ca45172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92266f2b-5066-4d2e-b0a0-49f3ac0e3510", "name": "network-vif-deleted", "tag": "8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:14.725943 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9dd88b41-159e-402b-83d9-d978e633908b req-e333ac3c-6fc2-42d4-b0ef-4aa18ca45172 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:14.730575 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9dd88b41-159e-402b-83d9-d978e633908b req-e333ac3c-6fc2-42d4-b0ef-4aa18ca45172 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:14.732401 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9dd88b41-159e-402b-83d9-d978e633908b req-e333ac3c-6fc2-42d4-b0ef-4aa18ca45172 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:14.761479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-9dd88b41-159e-402b-83d9-d978e633908b req-e333ac3c-6fc2-42d4-b0ef-4aa18ca45172 service nova] Creating event network-vif-deleted:8685ce69-1bf7-4cc0-9f5e-48bb34ceed2b for instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 on hv-cinder-84605 Aug 24 12:38:14.773142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-9dd88b41-159e-402b-83d9-d978e633908b req-e333ac3c-6fc2-42d4-b0ef-4aa18ca45172 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062954 Aug 24 12:38:14.774254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 348/698] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:15.179083 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:15.179717 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:15.193151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.193905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.197206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.210853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.213041 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.213843 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.513184 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:15.534359 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-360a2157-fa20-4bbd-81f4-526f493b3120 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1548 microversion: 2.1 time: 0.359091 Aug 24 12:38:15.536490 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 351/699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:15 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1548 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:15.561172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:15.562393 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:15.570752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.571552 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.572204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.573196 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.573982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.574613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.618928 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:15.619991 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 92266f2b-5066-4d2e-b0a0-49f3ac0e3510] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:15.629974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.630774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.631429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.632353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:15.633044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:15.633692 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:15.672295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] HTTP exception thrown: Instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 could not be found. Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Request method failure captured: Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 HTTP/1.1 Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp5kFLOwMoQfDuoqV9OaiK27E3R7iCj1fFESiH9PZCFXQFTab8fK-2w8Bs8_TMr_SLLsSiPZ4ZwQW6ZNcR_qqKoizjITLf3aHbmVnciBlzkKvnBeBZAqhV0hF3FMuMygkwYRZece1uvcRkCz7ssTDpdPE-epN1q1H3jWavzuwztb7I Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:38:15.675105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}] Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: e34cbcf69b4b4828a3bca077fc8d0694 Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 could not be found. Aug 24 12:38:15.676423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '92266f2b-5066-4d2e-b0a0-49f3ac0e3510'} Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 could not be found. Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:15.677171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 could not be found. Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 could not be found. Aug 24 12:38:15.678667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:15.692776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Returning 404 to user: Instance 92266f2b-5066-4d2e-b0a0-49f3ac0e3510 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:15.693898 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-869d303b-a7cc-4080-94b0-553ba2b6cd4b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510" status: 404 len: 111 microversion: 2.1 time: 0.078823 Aug 24 12:38:15.694999 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 352/700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:15 2022] GET /compute/v2.1/servers/92266f2b-5066-4d2e-b0a0-49f3ac0e3510 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:15.715682 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-17771deb-1bb9-4532-af95-0952d91bcf07 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '.version_select at 0x7fa676ca1670>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:15.742182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-17771deb-1bb9-4532-af95-0952d91bcf07 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749837459" status: 202 len: 0 microversion: 2.1 time: 0.041915 Aug 24 12:38:15.745928 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 353/701] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Aug 24 12:38:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749837459 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:38:15.748833 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5d1c33db-4989-42d1-bd3a-c6e65b0ed068 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191689 Aug 24 12:38:15.748833 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 349/702] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 12:38:15 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:17.935035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-9b98c5de-9cf9-4f6d-a8b8-698dd2dba90b req-175a97ce-e008-4334-81da-520e198e523e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35478048-ed82-46ca-af89-72f4f56abb58", "tag": "4002fdef-db85-47a2-aecc-5abe1e61a01b"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:17.947173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1010d4fd-5717-49a1-8e7b-575a8a8f49fc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Action: 'create', calling method: .version_select at 0x7fa676b21af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1671158803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVd5UevYdFvrE18mpZtvl2NhBGHzFsw2631MTolhvLZeQE8v3xO/kbEDkqpyAmjF1BJlQwDnwCHF+d3BDUsXfB0K14jRc1Ai8X9B/CShwIqCaKPptn9Kisgi5i2TuKNLw=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:17.947738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9b98c5de-9cf9-4f6d-a8b8-698dd2dba90b req-175a97ce-e008-4334-81da-520e198e523e service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:17.947738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9b98c5de-9cf9-4f6d-a8b8-698dd2dba90b req-175a97ce-e008-4334-81da-520e198e523e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:17.948180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9b98c5de-9cf9-4f6d-a8b8-698dd2dba90b req-175a97ce-e008-4334-81da-520e198e523e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:17.960110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-9b98c5de-9cf9-4f6d-a8b8-698dd2dba90b req-175a97ce-e008-4334-81da-520e198e523e service nova] Creating event network-changed:4002fdef-db85-47a2-aecc-5abe1e61a01b for instance 35478048-ed82-46ca-af89-72f4f56abb58 on hv-cinder-84605 Aug 24 12:38:17.966020 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-9b98c5de-9cf9-4f6d-a8b8-698dd2dba90b req-175a97ce-e008-4334-81da-520e198e523e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199190 Aug 24 12:38:17.967089 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 354/703] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:17.975661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-1010d4fd-5717-49a1-8e7b-575a8a8f49fc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Getting quotas for project e112083132a9492089fafdae9e34f4ff. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:38:17.981371 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-1010d4fd-5717-49a1-8e7b-575a8a8f49fc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Getting quotas for user ae1cd97c879141e2b4c1527b5964d054 and project e112083132a9492089fafdae9e34f4ff. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:38:18.008302 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1010d4fd-5717-49a1-8e7b-575a8a8f49fc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.272192 Aug 24 12:38:18.009615 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 350/704] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:38:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:19.124059 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:19.124973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:19.132739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.133557 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.134773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.136049 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.137460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.138229 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.175279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Going to try to terminate instance {{(pid=127299) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:38:19.272503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7b83f64a-69aa-4b2e-a891-c263abaa6aab tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 204 len: 0 microversion: 2.1 time: 0.153646 Aug 24 12:38:19.274069 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 355/705] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:19 2022] DELETE /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:38:19.282485 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:19.283867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:19.297936 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.299452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.300058 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.301167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:19.302082 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:19.302733 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:19.474839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:19.487862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-70155577-b8f2-4997-bb0e-13b9f9515aeb tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1509 microversion: 2.1 time: 0.206494 Aug 24 12:38:19.487862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 351/706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:19 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:20.509822 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:20.509822 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:20.514854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.515298 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.515944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.516619 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:20.517060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:20.517472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:20.691110 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:20.699525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d9c8fa67-229d-4551-a8d6-46e8ad688839 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1509 microversion: 2.1 time: 0.196273 Aug 24 12:38:20.700368 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 356/707] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:20 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:21.721262 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:21.722835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:21.730490 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.731316 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.731752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:21.732499 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:21.733008 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:21.733432 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.141959 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:22.150593 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-caa44c4a-934e-4631-b9e5-06b80ad8af9d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1509 microversion: 2.1 time: 0.433399 Aug 24 12:38:22.151598 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 352/708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:21 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1509 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:22.913197 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eca198df-0afe-49c5-bf45-34e8b5e15cef"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:22.915851 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:22.924417 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.925123 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.925631 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.926648 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:22.926959 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:22.927330 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:22.931842 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:23.036140 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Invalid volume: volume eca198df-0afe-49c5-bf45-34e8b5e15cef is already attached to instances: e224a672-083c-40d5-a171-d4d92b90ee52 Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: POST /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments HTTP/1.1 Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 74 Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:38:23.038199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {"volumeAttachment": {"volumeId": "eca198df-0afe-49c5-bf45-34e8b5e15cef"}} Aug 24 12:38:23.039786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Invalid volume: volume eca198df-0afe-49c5-bf45-34e8b5e15cef is already attached to instances: e224a672-083c-40d5-a171-d4d92b90ee52 Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'server_id': 'e224a672-083c-40d5-a171-d4d92b90ee52', 'body': {'volumeAttachment': {'volumeId': 'eca198df-0afe-49c5-bf45-34e8b5e15cef'}}} Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eca198df-0afe-49c5-bf45-34e8b5e15cef is already attached to instances: e224a672-083c-40d5-a171-d4d92b90ee52 Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:23.040573 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eca198df-0afe-49c5-bf45-34e8b5e15cef is already attached to instances: e224a672-083c-40d5-a171-d4d92b90ee52 Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:23.042064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:23.043462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:23.043462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:23.043462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:23.043462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eca198df-0afe-49c5-bf45-34e8b5e15cef is already attached to instances: e224a672-083c-40d5-a171-d4d92b90ee52 Aug 24 12:38:23.043462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:23.043462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 400 to user: Invalid volume: volume eca198df-0afe-49c5-bf45-34e8b5e15cef is already attached to instances: e224a672-083c-40d5-a171-d4d92b90ee52 {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:23.043462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-aa499e6e-b162-4ab3-9b3e-5055061597ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131211 Aug 24 12:38:23.043462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 357/709] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:38:22 2022] POST /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:38:23.129151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:23.129825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:23.137022 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.137544 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.138122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.139431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.139431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.139822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.188299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:23.188299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:23.190304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.190799 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.191231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.191937 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.192383 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.200841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.263670 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lazy-loading 'services' on Instance uuid e224a672-083c-40d5-a171-d4d92b90ee52 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:38:23.298039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:23.310845 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b4300abe-c3ee-4261-b141-a790f6345610 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 200 len: 1467 microversion: 2.1 time: 0.143031 Aug 24 12:38:23.311428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 358/710] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:23 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 1467 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:23.382077 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-1e7b4d5b-03fa-4efc-967e-6f0accd3b00c req-5faf6139-de65-4cca-87ea-68ee7c3b4ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6982a702-24f0-405c-8928-60dce62be5c5", "name": "network-vif-deleted", "tag": "7e5498b6-b445-42d1-9bfa-73ca88c03b12"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:23.382358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2cc1e0dd-0321-4097-bc42-496d3ec6f294 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments/eca198df-0afe-49c5-bf45-34e8b5e15cef" status: 202 len: 0 microversion: 2.1 time: 0.259377 Aug 24 12:38:23.383825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 353/711] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:38:23 2022] DELETE /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments/eca198df-0afe-49c5-bf45-34e8b5e15cef => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:38:23.395024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:23.397870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:23.398417 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-1e7b4d5b-03fa-4efc-967e-6f0accd3b00c req-5faf6139-de65-4cca-87ea-68ee7c3b4ddf service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.398919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-1e7b4d5b-03fa-4efc-967e-6f0accd3b00c req-5faf6139-de65-4cca-87ea-68ee7c3b4ddf service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.399614 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-1e7b4d5b-03fa-4efc-967e-6f0accd3b00c req-5faf6139-de65-4cca-87ea-68ee7c3b4ddf service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.404531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.405301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.406458 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.407279 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:23.407743 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:23.408389 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:23.420357 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-1e7b4d5b-03fa-4efc-967e-6f0accd3b00c req-5faf6139-de65-4cca-87ea-68ee7c3b4ddf service nova] Creating event network-vif-deleted:7e5498b6-b445-42d1-9bfa-73ca88c03b12 for instance 6982a702-24f0-405c-8928-60dce62be5c5 on hv-cinder-84605 Aug 24 12:38:23.427419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-1e7b4d5b-03fa-4efc-967e-6f0accd3b00c req-5faf6139-de65-4cca-87ea-68ee7c3b4ddf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113058 Aug 24 12:38:23.428033 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 359/712] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:23.446309 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b122441d-7f4e-4663-94d6-046829425c94 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056541 Aug 24 12:38:23.446890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 354/713] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:23 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:24.333363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:24.334084 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 6982a702-24f0-405c-8928-60dce62be5c5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:24.341018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.341455 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.341905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.342616 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.343079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.343705 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.359534 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] HTTP exception thrown: Instance 6982a702-24f0-405c-8928-60dce62be5c5 could not be found. Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Request method failure captured: Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 HTTP/1.1 Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp5kFLOwMoQfDuoqV9OaiK27E3R7iCj1fFESiH9PZCFXQFTab8fK-2w8Bs8_TMr_SLLsSiPZ4ZwQW6ZNcR_qqKoizjITLf3aHbmVnciBlzkKvnBeBZAqhV0hF3FMuMygkwYRZece1uvcRkCz7ssTDpdPE-epN1q1H3jWavzuwztb7I Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:38:24.361353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}] Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: e34cbcf69b4b4828a3bca077fc8d0694 Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 6982a702-24f0-405c-8928-60dce62be5c5 could not be found. Aug 24 12:38:24.362973 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '6982a702-24f0-405c-8928-60dce62be5c5'} Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6982a702-24f0-405c-8928-60dce62be5c5 could not be found. Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:24.363802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6982a702-24f0-405c-8928-60dce62be5c5 could not be found. Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6982a702-24f0-405c-8928-60dce62be5c5 could not be found. Aug 24 12:38:24.365302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:24.366611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Returning 404 to user: Instance 6982a702-24f0-405c-8928-60dce62be5c5 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:24.366611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2c5988b1-514b-4a58-8ffd-66b22034e9ee tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5" status: 404 len: 111 microversion: 2.1 time: 0.034186 Aug 24 12:38:24.366611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 360/714] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:24 2022] GET /compute/v2.1/servers/6982a702-24f0-405c-8928-60dce62be5c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:24.373975 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:24.374495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:24.381734 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.382218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.382652 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.383345 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.383788 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.384211 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.416500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:38:24.460689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:24.463245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:24.471346 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.471962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.472492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.473329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.473876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.474578 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.509140 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-51696559-5eb0-487c-a132-0d01e435cf88 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "DELETE /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 204 len: 0 microversion: 2.1 time: 0.140159 Aug 24 12:38:24.510089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 355/715] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:24 2022] DELETE /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:38:24.515967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c2adfc77-3e33-49cc-9aa8-272f87e7720f tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060047 Aug 24 12:38:24.517245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 361/716] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:24 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:24.526005 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:24.526841 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:24.534416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.535011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.535440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.536230 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:24.536705 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:24.537125 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:24.671119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:24.680134 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e5db9cd7-3cd0-484d-8142-d06a47459f0d tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.159599 Aug 24 12:38:24.680941 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 356/717] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:24 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:25.529452 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:25.531749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:25.538647 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.539141 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.539571 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.540266 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.540741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.541177 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.576024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-77b2f324-ad5c-4277-ae29-066b96b8744a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050539 Aug 24 12:38:25.576575 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 362/718] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:25 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:25.703891 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:25.704498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:25.707913 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:25.714606 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.715225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.715775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.716804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:25.717448 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:25.718000 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:25.858611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:25.871174 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9e398484-f82f-407f-a838-1963a99c006a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.173173 Aug 24 12:38:25.872123 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 357/719] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:25 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:26.590024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:26.592565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:26.601322 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.601789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.602242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.602955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.603404 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.603824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.634635 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-35aa7c05-1eac-4a41-8a55-e38e07bd8291 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049382 Aug 24 12:38:26.635211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 363/720] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:26 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:26.899628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:26.900250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:26.907132 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.907621 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.908055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:26.908779 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:26.909224 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:26.909656 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.042585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:27.056924 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-78b3971c-ac81-426d-b1b6-d6335bbd802b tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.161273 Aug 24 12:38:27.057518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 358/721] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:26 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:27.650903 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:27.654390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:27.665005 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.665754 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.666416 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.667486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.668180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.668866 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.701066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-026414e6-01d2-4ed5-b826-0b92e977e8f2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056751 Aug 24 12:38:27.701645 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 364/722] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:38:27 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:38:27.766455 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:27.766948 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:27.773134 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.773631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.774080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.774761 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.775259 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.775782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.803185 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:38:27.875111 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:27.906051 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1f2b7727-10ed-4daa-8039-0e293d090c3a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 204 len: 0 microversion: 2.1 time: 0.143059 Aug 24 12:38:27.906752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 359/723] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:38:27 2022] DELETE /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:38:27.915462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:27.916084 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:27.922561 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.923357 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.923793 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:27.924622 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:27.925113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:27.925531 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.085529 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:28.086739 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:28.088875 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=4 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:28.094819 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.095299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.095728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.096448 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.096930 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.097346 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.184800 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:28.194636 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8043e576-24de-4be2-b505-5d4e010dde13 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1680 microversion: 2.1 time: 0.283205 Aug 24 12:38:28.195704 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 365/724] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:27 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1680 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:38:28.332864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-46d26a58-1442-4421-b8bc-ad45a59497d3 req-c052a3d8-29aa-4262-8d3f-b786b6f00b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336ccc96-8289-4d8f-a2e0-6ee9d99345d7", "name": "network-vif-deleted", "tag": "8365150b-d0c5-46c0-a2b9-015d30aacc99"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:28.342128 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:28.343831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-46d26a58-1442-4421-b8bc-ad45a59497d3 req-c052a3d8-29aa-4262-8d3f-b786b6f00b94 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:28.344460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-46d26a58-1442-4421-b8bc-ad45a59497d3 req-c052a3d8-29aa-4262-8d3f-b786b6f00b94 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:28.344936 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-46d26a58-1442-4421-b8bc-ad45a59497d3 req-c052a3d8-29aa-4262-8d3f-b786b6f00b94 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:28.350039 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a39a336d-979a-462b-98f3-860cbde689b7 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1522 microversion: 2.1 time: 0.270003 Aug 24 12:38:28.350624 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 360/725] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:28 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:28.358030 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-46d26a58-1442-4421-b8bc-ad45a59497d3 req-c052a3d8-29aa-4262-8d3f-b786b6f00b94 service nova] Creating event network-vif-deleted:8365150b-d0c5-46c0-a2b9-015d30aacc99 for instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 on hv-cinder-84605 Aug 24 12:38:28.363291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-46d26a58-1442-4421-b8bc-ad45a59497d3 req-c052a3d8-29aa-4262-8d3f-b786b6f00b94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034169 Aug 24 12:38:28.363875 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 366/726] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:29.221167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:29.222030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:29.232472 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.233145 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.234168 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.235079 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.235594 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.236742 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.372106 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:29.372858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:29.379268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:29.380206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.380725 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.381332 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.382063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:29.382717 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:29.383144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:29.387225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f941575d-da02-4818-8d3b-ca295ea0260c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1680 microversion: 2.1 time: 0.172253 Aug 24 12:38:29.387866 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 361/727] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:29 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:29.447307 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34cbcf69b4b4828a3bca077fc8d0694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3276a7bc6bb84ac7953d2d46c4298a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:29.456210 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-31061bdc-4e66-4883-939d-165ad4e51172 tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 200 len: 1480 microversion: 2.1 time: 0.088320 Aug 24 12:38:29.456839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 367/728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:29 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 1480 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:30.409560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:30.410275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:30.417156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:30.417639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:30.418070 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.418831 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:30.419279 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:30.419698 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.481722 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:30.484991 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] [instance: 336ccc96-8289-4d8f-a2e0-6ee9d99345d7] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:30.499467 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:30.500169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:30.500169 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.500943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:30.501404 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:30.501833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:30.517438 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] HTTP exception thrown: Instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 could not be found. Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Request method failure captured: Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 HTTP/1.1 Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp5kFLOwMoQfDuoqV9OaiK27E3R7iCj1fFESiH9PZCFXQFTab8fK-2w8Bs8_TMr_SLLsSiPZ4ZwQW6ZNcR_qqKoizjITLf3aHbmVnciBlzkKvnBeBZAqhV0hF3FMuMygkwYRZece1uvcRkCz7ssTDpdPE-epN1q1H3jWavzuwztb7I Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:38:30.519449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3276a7bc6bb84ac7953d2d46c4298a23"}]}] Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 3276a7bc6bb84ac7953d2d46c4298a23 Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1111769485 Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: e34cbcf69b4b4828a3bca077fc8d0694 Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1111769485-project Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 could not be found. Aug 24 12:38:30.521038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '336ccc96-8289-4d8f-a2e0-6ee9d99345d7'} Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 could not be found. Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:30.521967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 could not be found. Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 could not be found. Aug 24 12:38:30.523532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:30.525773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] Returning 404 to user: Instance 336ccc96-8289-4d8f-a2e0-6ee9d99345d7 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:30.527167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8c926b67-953d-4435-bc1d-f0653562944a tempest-ServerRescueNegativeTestJSON-1111769485 tempest-ServerRescueNegativeTestJSON-1111769485-project] 10.222.0.27 "GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7" status: 404 len: 111 microversion: 2.1 time: 0.051505 Aug 24 12:38:30.527987 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 368/729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:30 2022] GET /compute/v2.1/servers/336ccc96-8289-4d8f-a2e0-6ee9d99345d7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 12:38:30.823514 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:30.832549 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2a0aa5ac-de96-4fb1-badd-3e1695abb161 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1680 microversion: 2.1 time: 0.427647 Aug 24 12:38:30.833174 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 362/730] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:30 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1680 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:31.227914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-45622433-8442-4411-9c0d-4ea0f571b061 req-c0b8bb69-a17d-41bd-ab1a-b5b98d9007c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e224a672-083c-40d5-a171-d4d92b90ee52", "name": "network-vif-deleted", "tag": "5115a01a-8526-49be-a576-d36b19e4542c"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:31.238565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-45622433-8442-4411-9c0d-4ea0f571b061 req-c0b8bb69-a17d-41bd-ab1a-b5b98d9007c0 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.239035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-45622433-8442-4411-9c0d-4ea0f571b061 req-c0b8bb69-a17d-41bd-ab1a-b5b98d9007c0 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.239522 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-45622433-8442-4411-9c0d-4ea0f571b061 req-c0b8bb69-a17d-41bd-ab1a-b5b98d9007c0 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.252764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-45622433-8442-4411-9c0d-4ea0f571b061 req-c0b8bb69-a17d-41bd-ab1a-b5b98d9007c0 service nova] Creating event network-vif-deleted:5115a01a-8526-49be-a576-d36b19e4542c for instance e224a672-083c-40d5-a171-d4d92b90ee52 on hv-cinder-84605 Aug 24 12:38:31.258857 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-45622433-8442-4411-9c0d-4ea0f571b061 req-c0b8bb69-a17d-41bd-ab1a-b5b98d9007c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Aug 24 12:38:31.260045 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 369/731] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:31.855014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:31.856274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:31.863631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.864412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.865050 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.865958 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.866579 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.867186 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.920521 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:31.921358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:31.922184 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:31.922650 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lazy-loading 'fault' on Instance uuid e224a672-083c-40d5-a171-d4d92b90ee52 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:38:31.969366 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:31.989773 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-42c2a498-c964-4914-8322-5940b0c4aeb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 200 len: 1332 microversion: 2.1 time: 0.138541 Aug 24 12:38:31.990398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 363/732] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:31 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:33.012884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:33.013679 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:33.020779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:33.021345 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:33.021838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:33.022617 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:33.023129 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:33.023612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:33.037615 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 HTTP/1.1 Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:38:33.039328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:38:33.040913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': 'e224a672-083c-40d5-a171-d4d92b90ee52'} Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:33.041797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:38:33.043244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:38:33.044510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:33.044510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1206fa63-bf8f-40fa-8892-1bfd55ccee18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 404 len: 111 microversion: 2.1 time: 0.034092 Aug 24 12:38:33.044510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 370/733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:33 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:33.053030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cf32e62f-2c76-473d-90bb-132877916383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '.version_select at 0x7fa676ba5040>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:33.074118 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cf32e62f-2c76-473d-90bb-132877916383 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000498158" status: 202 len: 0 microversion: 2.1 time: 0.024894 Aug 24 12:38:33.074681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 364/734] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 12:38:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000498158 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:38:33.801133 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-eda9123d-ff67-4120-8bc4-5b1917316fa4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: .version_select at 0x7fa676cd79d0>, body: {"keypair": {"name": "tempest-keypair-1602405780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZRvKuStcTYUOnSNm5fjqRTU/fRVD8dDPHPdDQogK9DbhZ0MmRiHdcjrJRkDRQHQZC8+JsbWJUNA1bSimheIko/QgWCRPS3KWrkZPLuwWLt4rhFz3xANDPzax16PQKwOA=="}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:33.805931 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-eda9123d-ff67-4120-8bc4-5b1917316fa4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for project 75590a43f50b48699fc0d5a892a99544. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:38:33.810330 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-eda9123d-ff67-4120-8bc4-5b1917316fa4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for user b4a617fc13534a89ad50a5fdc7bf769a and project 75590a43f50b48699fc0d5a892a99544. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:38:33.843419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-eda9123d-ff67-4120-8bc4-5b1917316fa4 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056534 Aug 24 12:38:33.844915 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 371/735] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:38:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:35.370575 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-950293424", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bd462f6-55a5-43db-8eee-5cc12a9f44b1"}], "security_groups": [{"name": "tempest-securitygroup--1225720935"}], "key_name": "tempest-keypair-1602405780", "user_data": "}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:35.397317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-555e3b2c-9336-4d7e-a6d9-cc4cac17daab tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Action: 'create', calling method: .version_select at 0x7fa676bebd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-786901379", "metadata": {"Type": "work"}}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:35.488167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] validate_networks() for [('3bd462f6-55a5-43db-8eee-5cc12a9f44b1', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:38:35.726232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-555e3b2c-9336-4d7e-a6d9-cc4cac17daab tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.461275 Aug 24 12:38:35.727206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 365/736] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 24 12:38:35 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 463 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 12:38:35.739937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bff18a43-51bb-421a-8fe5-0aad23938e65 tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Calling method '.version_select at 0x7fa676b86ca0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:35.791096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bff18a43-51bb-421a-8fe5-0aad23938e65 tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8" status: 200 len: 352 microversion: 2.1 time: 0.055257 Aug 24 12:38:35.791671 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 366/737] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:38:35 2022] GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:35.994061 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:38:35.994460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:38:35.994984 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:38:35.995389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:38:35.995826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:38:36.005844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.006334 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.006870 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.007592 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.008042 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.008461 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.025833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for project 75590a43f50b48699fc0d5a892a99544. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:38:36.029760 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Getting quotas for user b4a617fc13534a89ad50a5fdc7bf769a and project 75590a43f50b48699fc0d5a892a99544. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:38:36.040914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:38:36.043217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:38:36.083297 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-918307837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1671158803", "security_groups": [{"name": "tempest-secgroup-smoke-1828489185"}], "block_device_mapping_v2": [{"uuid": "198749af-ab13-4fab-8fe6-d56ee9642818", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d723da1-b583-4f4b-bb15-ebfb46f0946c"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:36.097221 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c1097596-809b-4338-881c-8a84641e2185 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.731801 Aug 24 12:38:36.102340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 372/738] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:38:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:38:36.110058 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7f1079ab-e2fd-4b2d-91f6-8e14942ccff2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:36.110701 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7f1079ab-e2fd-4b2d-91f6-8e14942ccff2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:36.178655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7f1079ab-e2fd-4b2d-91f6-8e14942ccff2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:36.185864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7f1079ab-e2fd-4b2d-91f6-8e14942ccff2 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1241 microversion: 2.1 time: 0.080697 Aug 24 12:38:36.186743 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 373/739] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:36 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:36.228138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] validate_networks() for [('3d723da1-b583-4f4b-bb15-ebfb46f0946c', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:38:36.680356 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:38:36.680986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:38:36.681266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:38:36.681678 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:38:36.682084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:38:36.692238 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.692754 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.693188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.693938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:36.694396 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:36.694814 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:36.712678 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Getting quotas for project e112083132a9492089fafdae9e34f4ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:38:36.717022 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Getting quotas for user ae1cd97c879141e2b4c1527b5964d054 and project e112083132a9492089fafdae9e34f4ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:38:36.777664 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:38:36.781538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='198749af-ab13-4fab-8fe6-d56ee9642818',volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:38:36.805037 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e5912c22-feff-470c-af31-d266cbc1d68f tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Calling method '.version_select at 0x7fa676cf01f0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:36.864479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e5912c22-feff-470c-af31-d266cbc1d68f tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8" status: 200 len: 353 microversion: 2.1 time: 0.063308 Aug 24 12:38:36.865072 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 374/740] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:38:36 2022] GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:36.877995 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-76e35af9-b035-452a-88c7-5d74ff2f1268 tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Calling method '.version_select at 0x7fa676cd73a0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:36.927805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-76e35af9-b035-452a-88c7-5d74ff2f1268 tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8" status: 200 len: 353 microversion: 2.1 time: 0.054338 Aug 24 12:38:36.928373 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 375/741] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:38:36 2022] GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:36.943213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f9d72752-2f3a-4743-833d-dda8a7d7b026 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.864187 Aug 24 12:38:36.944049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 367/742] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:38:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 12:38:36.945624 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1ce33a65-adc1-4aef-a1c8-1723cca636db tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Calling method '.version_select at 0x7fa676cd3a60>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:36.955303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-291c3eab-0dc0-4d3c-943c-1501b99fc3e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:36.955932 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-291c3eab-0dc0-4d3c-943c-1501b99fc3e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:37.012620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1ce33a65-adc1-4aef-a1c8-1723cca636db tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8" status: 202 len: 0 microversion: 2.1 time: 0.070840 Aug 24 12:38:37.013215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 376/743] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:38:36 2022] DELETE /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:38:37.021788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5df94080-16a0-4747-bce4-c0eb23f614ea tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Calling method '.version_select at 0x7fa676d21c10>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:37.022627 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-291c3eab-0dc0-4d3c-943c-1501b99fc3e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:37.034059 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-291c3eab-0dc0-4d3c-943c-1501b99fc3e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1094 microversion: 2.1 time: 0.082798 Aug 24 12:38:37.034650 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 368/744] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:36 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:37.075740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5df94080-16a0-4747-bce4-c0eb23f614ea tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8" status: 200 len: 352 microversion: 2.1 time: 0.057809 Aug 24 12:38:37.076335 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 377/745] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:38:37 2022] GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:37.208779 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:37.209395 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:37.218664 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:37.219607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:37.220056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:37.220796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:37.221251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:37.221680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:37.299487 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:37.309223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-87d24a26-9c5e-4aad-9ec3-50991c994f57 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1293 microversion: 2.1 time: 0.105497 Aug 24 12:38:37.310783 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 369/746] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:37 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:38.057064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:38.057902 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:38.061296 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:38.065587 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.066400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.066805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.067684 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.068242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.068694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.091153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b8655e44-ba06-4eed-b354-a5927eaddacf tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Calling method '.version_select at 0x7fa676beb8b0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:38.127525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-b8655e44-ba06-4eed-b354-a5927eaddacf tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] HTTP exception thrown: Volume 05e4cd10-492a-4dc2-b6b0-d88819ca78b8 could not be found. Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b8655e44-ba06-4eed-b354-a5927eaddacf tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Request method failure captured: Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8 HTTP/1.1 Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhvLp63s81rFCZi6KEwl6cifbha5CYCygSJmDcX0-F-1YJPudbVK_j4WMulc-ISABXlb7hM-qnV7rMvuSjbxK_SwuYB2hkH1po7bTJ_Dh-SY5XtlWef2QumCF52Zh0Tv_GmnuZrA_H91oxLPMeeSq8tKE8PvGRrgrS0DeZW9QjJFV6I Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 5d67f75cc6904cc889ca0f678df98b9c Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesGetTestJSON-1723410629 Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:38:38.129724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d67f75cc6904cc889ca0f678df98b9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d67f75cc6904cc889ca0f678df98b9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d67f75cc6904cc889ca0f678df98b9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d67f75cc6904cc889ca0f678df98b9c"}]}] Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesGetTestJSON-1723410629 Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 5d67f75cc6904cc889ca0f678df98b9c Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesGetTestJSON-1723410629 Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesGetTestJSON-1723410629-project Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: e9385e35bc7c462c87cf9e4092708bd9 Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesGetTestJSON-1723410629-project Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Volume 05e4cd10-492a-4dc2-b6b0-d88819ca78b8 could not be found. Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '05e4cd10-492a-4dc2-b6b0-d88819ca78b8'} Aug 24 12:38:38.131348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05e4cd10-492a-4dc2-b6b0-d88819ca78b8 could not be found. (HTTP 404) (Request-ID: req-a3ce8184-3583-4c9e-a4ee-a2cb1c22bf54) Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:38.132295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 12:38:38.134014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05e4cd10-492a-4dc2-b6b0-d88819ca78b8 could not be found. Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 12:38:38.137723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05e4cd10-492a-4dc2-b6b0-d88819ca78b8 could not be found. Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05e4cd10-492a-4dc2-b6b0-d88819ca78b8 could not be found. Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b8655e44-ba06-4eed-b354-a5927eaddacf tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] Returning 404 to user: Volume 05e4cd10-492a-4dc2-b6b0-d88819ca78b8 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b8655e44-ba06-4eed-b354-a5927eaddacf tempest-VolumesGetTestJSON-1723410629 tempest-VolumesGetTestJSON-1723410629-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8" status: 404 len: 109 microversion: 2.1 time: 0.045499 Aug 24 12:38:38.138955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 370/747] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 12:38:38 2022] GET /compute/v2.1/os-volumes/05e4cd10-492a-4dc2-b6b0-d88819ca78b8 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:38:38.166766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:38.178818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a98f01ff-0744-460a-9212-0ce913524d94 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1192 microversion: 2.1 time: 0.125952 Aug 24 12:38:38.179481 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 378/748] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:38 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1192 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:38.335301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:38.335935 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:38.345128 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.345621 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.346054 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.347019 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:38.347483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:38.347910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:38.667973 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:38.677085 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e054c3be-29cc-4625-8909-c891de65afe1 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1367 microversion: 2.1 time: 0.348652 Aug 24 12:38:38.677589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 371/749] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:38 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:39.200222 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:39.201175 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:39.208569 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.209264 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.209817 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.210641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.211272 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.211911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.301055 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:39.309788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a059cfd6-9735-4079-b66c-a9315825c6cb tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1198 microversion: 2.1 time: 0.114351 Aug 24 12:38:39.310700 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 379/750] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:39 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:39.698008 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:39.699417 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:39.706911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.707713 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.708338 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:39.709070 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:39.709731 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:39.710313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.007677 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:40.017800 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c0c7d2e2-db99-4045-a9f0-312d0eec0ddb tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1367 microversion: 2.1 time: 0.323649 Aug 24 12:38:40.018572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 372/751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:39 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:40.155355 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-84ab24d0-9d91-4551-baba-71b20586e6e3 req-bfa2820b-e9e2-49f8-bb2c-df497f0f1d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb76e27c-bcd8-4e62-94dd-fb4bb902db49", "tag": "ddeb7a47-d3ed-4c4b-b0e0-388768a83c40"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:40.172032 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-84ab24d0-9d91-4551-baba-71b20586e6e3 req-bfa2820b-e9e2-49f8-bb2c-df497f0f1d0d service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.173802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-84ab24d0-9d91-4551-baba-71b20586e6e3 req-bfa2820b-e9e2-49f8-bb2c-df497f0f1d0d service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.174822 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-84ab24d0-9d91-4551-baba-71b20586e6e3 req-bfa2820b-e9e2-49f8-bb2c-df497f0f1d0d service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.191964 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-84ab24d0-9d91-4551-baba-71b20586e6e3 req-bfa2820b-e9e2-49f8-bb2c-df497f0f1d0d service nova] Creating event network-changed:ddeb7a47-d3ed-4c4b-b0e0-388768a83c40 for instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 on hv-cinder-84605 Aug 24 12:38:40.198072 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-84ab24d0-9d91-4551-baba-71b20586e6e3 req-bfa2820b-e9e2-49f8-bb2c-df497f0f1d0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048869 Aug 24 12:38:40.198581 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 380/752] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:40.237914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:40.238654 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:40.246878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.247758 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.248605 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.249796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.250565 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.251272 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.279642 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3963a3c0-292c-46e3-a759-e83af1ee071b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/ips" status: 200 len: 151 microversion: 2.20 time: 0.046671 Aug 24 12:38:40.287984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 373/753] 10.222.0.27 () {60 vars in 1289 bytes} [Wed Aug 24 12:38:40 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:38:40.331471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:40.332430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:40.343532 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.344609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.345392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.346434 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:40.347311 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:40.349085 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:40.728051 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:40.738017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-31248b68-466a-49a8-9e3a-761d4715af61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.410748 Aug 24 12:38:40.739285 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 381/754] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:40 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:41.039210 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:41.039994 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:41.048336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.049027 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.049765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.050847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.051388 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.052089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.262704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:41.271460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-86c22684-ccb4-44f6-ad28-2e3b92122ce8 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1367 microversion: 2.1 time: 0.236136 Aug 24 12:38:41.272342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 374/755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:41 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:41.759254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:41.759861 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:41.768921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.769411 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.769846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.770546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:41.771176 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:41.771579 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:41.935185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:41.943511 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-132981d1-6961-4c86-9982-67bb845bb614 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.187989 Aug 24 12:38:41.943916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 382/756] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:41 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:42.242068 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-8f1dceaa-f916-4c40-91b9-4a6ad6e41beb req-c0166327-b4ad-4c62-baec-e09d8c7bd309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df", "tag": "8372afc8-cc13-47d6-b4ca-043f1caa17ab"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:42.252878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-8f1dceaa-f916-4c40-91b9-4a6ad6e41beb req-c0166327-b4ad-4c62-baec-e09d8c7bd309 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.253358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-8f1dceaa-f916-4c40-91b9-4a6ad6e41beb req-c0166327-b4ad-4c62-baec-e09d8c7bd309 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.253784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-8f1dceaa-f916-4c40-91b9-4a6ad6e41beb req-c0166327-b4ad-4c62-baec-e09d8c7bd309 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.265573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-8f1dceaa-f916-4c40-91b9-4a6ad6e41beb req-c0166327-b4ad-4c62-baec-e09d8c7bd309 service nova] Creating event network-changed:8372afc8-cc13-47d6-b4ca-043f1caa17ab for instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df on hv-cinder-84605 Aug 24 12:38:42.271148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-8f1dceaa-f916-4c40-91b9-4a6ad6e41beb req-c0166327-b4ad-4c62-baec-e09d8c7bd309 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032872 Aug 24 12:38:42.272229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 375/757] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:42.294197 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:42.294375 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:42.294975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:42.295118 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:42.302743 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.303638 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.303878 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.304302 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.304512 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.304875 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.305684 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.306049 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.306166 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.306251 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.306754 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.306874 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.331748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lazy-loading 'flavor' on Instance uuid 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:38:42.386358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:42.528265 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-129b57f4-eb68-4567-82c7-8268ff0e2d41 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/action" status: 202 len: 0 microversion: 2.20 time: 0.238030 Aug 24 12:38:42.532113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 383/758] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 24 12:38:42 2022] POST /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:38:42.537879 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:42.538913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:42.545744 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.546263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.546684 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.547698 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.548138 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.548658 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.614597 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:42.623199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e1fa9d7b-d535-4463-9e05-7575a1cff9a0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1367 microversion: 2.1 time: 0.333238 Aug 24 12:38:42.624287 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 376/759] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:42 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:42.853019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:42.861882 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:42.863471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:42.864879 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b0cf3ce4-7859-493a-8cab-3bf2ee2e277b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.331372 Aug 24 12:38:42.865426 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 384/760] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:42 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:42.965898 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:42.966621 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:42.974185 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.975084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.975884 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:42.976711 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:42.977264 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:42.977801 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.138854 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:43.146482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e9940e81-c6a5-476a-aab8-6b6d722979a3 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.185768 Aug 24 12:38:43.147055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 377/761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:42 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:43.644250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:43.645028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:43.652496 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.653021 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.653456 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.654196 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.655004 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.655371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.887835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:43.888493 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:43.895858 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.896256 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.896693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:43.897404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:43.897853 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:43.898264 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.115592 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:44.123895 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7201ab80-ae7d-43de-877f-ce34ac85bb64 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1367 microversion: 2.1 time: 0.483577 Aug 24 12:38:44.124475 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 385/762] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:43 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:44.142653 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:44.155296 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:44.156947 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:44.158230 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-264e35d9-ae71-42b2-bf66-8c5ba45d69ef tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.274559 Aug 24 12:38:44.159101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 378/763] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:43 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:44.180392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:44.180392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:44.187132 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.187436 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.187867 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.188560 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:44.189040 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:44.189466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:44.336726 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:44.345757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-aea63a3c-b5d8-434f-b6e5-ad116f6c00d2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.169769 Aug 24 12:38:44.346441 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 386/764] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:44 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:45.145040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:45.145653 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:45.152522 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.153013 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.153445 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.154136 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.154679 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.155224 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.183357 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:45.184718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:45.199396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.200174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.200749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.201639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.202364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.202913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.343761 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:45.352440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4e84b02f-7656-49ca-8889-ac7d07bb6c51 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1367 microversion: 2.1 time: 0.211554 Aug 24 12:38:45.353146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 379/765] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:45 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:45.367080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:45.367872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:45.371371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:45.376001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.376516 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.376974 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.377699 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:45.378147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:45.378561 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:45.381284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:45.382779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:45.383963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fd39272e-a472-4556-903b-b014365c0b2e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.204963 Aug 24 12:38:45.384498 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 387/766] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:45 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:45.516498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:45.524410 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-acf1c007-b11c-4847-ae9d-f608858fe48f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.161250 Aug 24 12:38:45.525010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 380/767] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:45 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:46.385118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:46.385118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:46.385118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:46.385118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=12 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:46.385118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.385977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.385977 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.386152 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.386603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.387026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.408843 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:46.409541 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:46.416024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.416511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.417023 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.418449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.418449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.418680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.588802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:46.599919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-093c4d13-2bf4-49b7-978a-15763d38e814 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1367 microversion: 2.1 time: 0.229694 Aug 24 12:38:46.600740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 388/768] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:46 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:46.607091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:46.607785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:46.617299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:46.624921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.625530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.625998 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.626936 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.627377 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.627795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.628203 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:46.629871 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:46.631190 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-86152974-6ef9-4f9a-a279-b9a419b6a172 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.227728 Aug 24 12:38:46.631834 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 381/769] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:46 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:38:46.731801 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:46.788080 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:46.799797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2b7778e7-cde0-4948-875e-b451fdcbc74c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.196848 Aug 24 12:38:46.800790 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 389/770] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:46 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:46.885137 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-2997c5c3-eac1-497b-a8f8-cdcba193b154 req-2ec39362-3b63-4021-8ef8-7eb77eb66722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb76e27c-bcd8-4e62-94dd-fb4bb902db49", "name": "network-vif-plugged", "status": "completed", "tag": "ddeb7a47-d3ed-4c4b-b0e0-388768a83c40"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:46.896159 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2997c5c3-eac1-497b-a8f8-cdcba193b154 req-2ec39362-3b63-4021-8ef8-7eb77eb66722 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:46.896631 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2997c5c3-eac1-497b-a8f8-cdcba193b154 req-2ec39362-3b63-4021-8ef8-7eb77eb66722 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:46.897084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2997c5c3-eac1-497b-a8f8-cdcba193b154 req-2ec39362-3b63-4021-8ef8-7eb77eb66722 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:46.908611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-2997c5c3-eac1-497b-a8f8-cdcba193b154 req-2ec39362-3b63-4021-8ef8-7eb77eb66722 service nova] Creating event network-vif-plugged:ddeb7a47-d3ed-4c4b-b0e0-388768a83c40 for instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 on hv-cinder-84605 Aug 24 12:38:46.914341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-2997c5c3-eac1-497b-a8f8-cdcba193b154 req-2ec39362-3b63-4021-8ef8-7eb77eb66722 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187028 Aug 24 12:38:46.915167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 382/771] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:38:47.621993 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.622638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.629608 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.630096 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.630522 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.631264 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.631699 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.632120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.652217 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=8 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:47.657963 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.658759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.677904 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.678385 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.678866 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.679563 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.680280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.680703 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.700228 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:47.821482 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:47.829743 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-378b7d96-6318-4218-bbca-2d2c0e4a5f18 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1367 microversion: 2.1 time: 0.211606 Aug 24 12:38:47.830329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 390/772] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:47.835199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:47.835807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:47.842039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.842854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.843526 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.844415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:47.844971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:47.845423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:47.864296 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:47.873676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:47.875370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:47.876769 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9cd119e3-c092-41ec-a12b-667ffab9d7f3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.225493 Aug 24 12:38:47.877703 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 383/773] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:38:47.989154 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:47.996989 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3dd85a04-66de-4c3d-aea8-c4f18eb53742 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.165453 Aug 24 12:38:47.997555 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 391/774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:47 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:48.850460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:48.851164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.858496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.859001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.859497 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.860181 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.860637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.861080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.899410 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:48.900088 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:48.907833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.908321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.908850 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:48.910382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:48.910839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:48.911262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.064760 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:49.073837 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-142c342c-3c08-4dba-aa50-6d9425846f81 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1557 microversion: 2.1 time: 0.227335 Aug 24 12:38:49.074410 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 384/775] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:48 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1557 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:49.079411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:49.080259 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:49.102761 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.103257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.103720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.104485 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.104977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.105400 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.106857 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:49.115496 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:49.117236 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:49.118658 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-8d6e4aa9-1c56-45ff-a87a-ab4e85ecba0c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.223125 Aug 24 12:38:49.119374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 392/776] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:48 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:49.124259 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:49.124844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:49.131092 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.131759 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.132343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.133217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:49.133817 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:49.134382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:49.273837 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-430bf16a-d994-4506-a9d0-a3105e70e15c tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153055 Aug 24 12:38:49.274550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 393/777] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 12:38:49 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:49.340503 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:49.351192 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9729b36e-2bd7-4a1a-9e6b-4980403bb6e6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.275560 Aug 24 12:38:49.352384 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 385/778] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:49 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:50.142621 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:50.143202 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:50.150000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.150503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.150940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.151651 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.152108 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.152517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.305712 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:50.316588 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:50.318098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:50.319262 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-064b3e8e-923b-4ace-a832-0d61374a3e38 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.181404 Aug 24 12:38:50.319824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 394/779] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:50 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:50.374261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:50.374960 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:50.383285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.384229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.384710 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.385441 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.385901 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.386330 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.537685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:50.548125 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-92e85504-3a0a-46a9-b2c3-84b84c9d0d33 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.177987 Aug 24 12:38:50.548905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 386/780] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:50 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:50.568341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-a9be50c0-ca57-4e60-ab73-c3ff53d7dc39 req-5b93814a-85a3-43cd-8506-6bb3e7a52607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb76e27c-bcd8-4e62-94dd-fb4bb902db49", "tag": "ddeb7a47-d3ed-4c4b-b0e0-388768a83c40"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:50.578460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a9be50c0-ca57-4e60-ab73-c3ff53d7dc39 req-5b93814a-85a3-43cd-8506-6bb3e7a52607 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:50.579013 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a9be50c0-ca57-4e60-ab73-c3ff53d7dc39 req-5b93814a-85a3-43cd-8506-6bb3e7a52607 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:50.579534 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a9be50c0-ca57-4e60-ab73-c3ff53d7dc39 req-5b93814a-85a3-43cd-8506-6bb3e7a52607 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:50.591143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-a9be50c0-ca57-4e60-ab73-c3ff53d7dc39 req-5b93814a-85a3-43cd-8506-6bb3e7a52607 service nova] Creating event network-changed:ddeb7a47-d3ed-4c4b-b0e0-388768a83c40 for instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 on hv-cinder-84605 Aug 24 12:38:50.596413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-a9be50c0-ca57-4e60-ab73-c3ff53d7dc39 req-5b93814a-85a3-43cd-8506-6bb3e7a52607 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031751 Aug 24 12:38:50.597270 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 395/781] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:51.342911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:51.343523 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:51.349753 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.350242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.350680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.351381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.351838 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.352264 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.529487 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:51.538456 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:51.540226 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:51.541444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8f7e4c0f-5d4e-491b-a274-84636047bcc4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.203219 Aug 24 12:38:51.542406 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 387/782] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:51 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:51.572124 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:51.572940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:51.579691 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.580095 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.580579 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.581438 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:51.582051 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:51.582931 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:51.731964 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:51.741546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ac112ed6-e346-4c1b-8579-56a055d8227b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.176191 Aug 24 12:38:51.742111 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 396/783] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:51 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:52.566341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:52.567094 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:52.574889 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.575386 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.575829 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.576934 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.577193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.577794 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.721767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:52.730887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:52.733844 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:52.735220 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dc812a66-3204-4f1e-b12c-425817cc94b3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.173778 Aug 24 12:38:52.735780 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 388/784] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:52 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:52.764835 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:52.765684 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:52.773683 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.774217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.774671 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.775576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:52.776209 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:52.777446 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:52.971124 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:52.990936 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f359fa99-98b2-4871-b491-866c86312d7e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.230793 Aug 24 12:38:52.991516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 397/785] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:52 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:53.758815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:53.759336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:53.766561 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:53.767046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:53.767477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:53.768186 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:53.768642 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:53.769106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:53.910055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:53.919325 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:53.920956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:53.922440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4d04bf87-ad54-40a9-9b9c-93b501322698 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.167835 Aug 24 12:38:53.922999 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 389/786] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:53 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:54.011388 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:54.011921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:54.018867 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.019325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.019748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.020422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.020899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.021312 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.159758 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:54.167958 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-db2e87fd-104a-4ec6-86b6-90e67008ba16 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.160412 Aug 24 12:38:54.168737 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 398/787] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:54 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:54.732739 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-bfbdc332-7923-45fe-8d9c-d89e2e384e73 req-d60fb4b6-c469-49e7-b4a6-c0b89cdc5678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df", "name": "network-vif-plugged", "status": "completed", "tag": "8372afc8-cc13-47d6-b4ca-043f1caa17ab"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:38:54.743660 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-bfbdc332-7923-45fe-8d9c-d89e2e384e73 req-d60fb4b6-c469-49e7-b4a6-c0b89cdc5678 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.744232 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-bfbdc332-7923-45fe-8d9c-d89e2e384e73 req-d60fb4b6-c469-49e7-b4a6-c0b89cdc5678 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.744628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-bfbdc332-7923-45fe-8d9c-d89e2e384e73 req-d60fb4b6-c469-49e7-b4a6-c0b89cdc5678 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.760596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-bfbdc332-7923-45fe-8d9c-d89e2e384e73 req-d60fb4b6-c469-49e7-b4a6-c0b89cdc5678 service nova] Creating event network-vif-plugged:8372afc8-cc13-47d6-b4ca-043f1caa17ab for instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df on hv-cinder-84605 Aug 24 12:38:54.771762 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-bfbdc332-7923-45fe-8d9c-d89e2e384e73 req-d60fb4b6-c469-49e7-b4a6-c0b89cdc5678 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042101 Aug 24 12:38:54.772951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 390/788] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:38:54.945427 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:54.946040 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:54.952913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.953652 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.954263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:54.955393 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:54.956029 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:54.956631 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.191258 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:55.191610 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:55.198412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.198903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.199339 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.200037 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:55.200477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:55.201254 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:55.212743 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:55.222118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:55.223698 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:55.225024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e4d64598-98d9-463b-90b1-ada437ac42af tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.283606 Aug 24 12:38:55.225804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 399/789] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:54 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:38:55.405482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:55.414538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-68f5afae-18cc-4995-898d-14f0f09e24cf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.227844 Aug 24 12:38:55.415104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 391/790] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:55 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:38:56.247772 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:56.248465 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:56.255201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.255682 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.256111 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.256828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.257275 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.257687 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.404247 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:56.407911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:56.413765 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:56.415247 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:56.416405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-4cbd6211-a456-48cf-ab41-39dacfc247c1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.172695 Aug 24 12:38:56.417220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 400/791] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:56 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:56.436326 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:56.437019 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:56.439524 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:38:56.446547 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.447043 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.447462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.448163 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:56.448617 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:56.449196 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:56.593897 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:56.601492 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7cc4831e-7625-433d-ab64-a18a80ceb752 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1266 microversion: 2.1 time: 0.169572 Aug 24 12:38:56.602059 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 392/792] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:56 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:57.441055 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.441680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.450064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.450507 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.451183 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.451892 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.452345 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.452799 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.596849 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:57.605054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:57.606543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:57.608160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fe340622-8b9f-419d-b7db-f6e55942d625 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.171054 Aug 24 12:38:57.608739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 401/793] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:57 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:57.621701 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.622882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.629745 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.630228 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.630674 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.631384 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.631832 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.632251 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.782192 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:57.790365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b12d51f4-4d8f-4906-b95e-cff55081c6f4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1453 microversion: 2.1 time: 0.173098 Aug 24 12:38:57.790932 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 393/794] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:57 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:57.812631 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:57.813266 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:57.819600 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.820102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.820528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.821241 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:57.821689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:57.822101 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:57.972308 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:57.980836 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-673a0e6c-0916-40d7-9bcb-c0adc0a471e2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1453 microversion: 2.1 time: 0.172409 Aug 24 12:38:57.981435 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 402/795] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:38:57 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:38:58.631580 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:58.645693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:58.645693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:58.645693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:58.645693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:58.646112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:58.646112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:58.646112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:58.919781 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:58.930921 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:58.932471 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:38:58.933679 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-506fbbeb-35b8-4628-8011-b92f3772057e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1745 microversion: 2.20 time: 0.305991 Aug 24 12:38:58.934225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 394/796] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:58 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1745 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:38:59.957996 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:38:59.958726 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:38:59.965746 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.966433 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.966890 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:38:59.967634 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:38:59.968075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:38:59.968504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.185037 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-7f348b5a-34b9-4f53-819b-1afdeb51aab5 req-8399a7ea-7f8d-4bb1-a612-3c02c9d1dc3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df", "tag": "8372afc8-cc13-47d6-b4ca-043f1caa17ab"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:00.201671 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-7f348b5a-34b9-4f53-819b-1afdeb51aab5 req-8399a7ea-7f8d-4bb1-a612-3c02c9d1dc3b service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:00.203585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-7f348b5a-34b9-4f53-819b-1afdeb51aab5 req-8399a7ea-7f8d-4bb1-a612-3c02c9d1dc3b service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:00.204140 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-7f348b5a-34b9-4f53-819b-1afdeb51aab5 req-8399a7ea-7f8d-4bb1-a612-3c02c9d1dc3b service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:00.216354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-7f348b5a-34b9-4f53-819b-1afdeb51aab5 req-8399a7ea-7f8d-4bb1-a612-3c02c9d1dc3b service nova] Creating event network-changed:8372afc8-cc13-47d6-b4ca-043f1caa17ab for instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df on hv-cinder-84605 Aug 24 12:39:00.221867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-7f348b5a-34b9-4f53-819b-1afdeb51aab5 req-8399a7ea-7f8d-4bb1-a612-3c02c9d1dc3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040767 Aug 24 12:39:00.222757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 395/797] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:00.249412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:00.257678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:00.259790 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:00.261321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-eee963de-e3ae-4424-a8cc-f6fc873b7898 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1745 microversion: 2.20 time: 0.307411 Aug 24 12:39:00.261948 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 403/798] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:38:59 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1745 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:01.285049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:01.286087 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:01.293142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.293718 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.294271 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.295286 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.296412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.296870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.438291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:01.446576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:01.448112 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:01.449398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1e95c25d-2498-43be-a260-f82f7fdc6d1d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.169133 Aug 24 12:39:01.449955 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 396/799] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:01 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:01.742489 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:01.743655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:01.757375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.758187 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.758855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.759646 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:01.760170 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:01.760984 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:01.786077 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1be3c1a2-e3a4-4869-a716-aa00949a8ebc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/ips" status: 200 len: 144 microversion: 2.1 time: 0.048457 Aug 24 12:39:01.786981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 404/800] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:39:01 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/ips => generated 144 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:02.476031 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:02.479056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:02.486544 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.487512 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.488169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.489926 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.490810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.491938 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.677413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:02.688325 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:02.689933 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:02.691213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-919702ae-27ad-49d1-b45b-444b75fb853b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.219771 Aug 24 12:39:02.691793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 397/801] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:02 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:02.844765 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-fd59f5e1-646b-4b99-a01f-1511b99d1a65 req-af46f627-de31-43a3-b011-d04f729cd4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8", "name": "network-vif-plugged", "status": "completed", "tag": "da3fa7cd-644d-43c9-a049-2c30fdb50dce"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:02.863803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-fd59f5e1-646b-4b99-a01f-1511b99d1a65 req-af46f627-de31-43a3-b011-d04f729cd4e1 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:02.864286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-fd59f5e1-646b-4b99-a01f-1511b99d1a65 req-af46f627-de31-43a3-b011-d04f729cd4e1 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:02.864747 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-fd59f5e1-646b-4b99-a01f-1511b99d1a65 req-af46f627-de31-43a3-b011-d04f729cd4e1 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:02.888614 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-fd59f5e1-646b-4b99-a01f-1511b99d1a65 req-af46f627-de31-43a3-b011-d04f729cd4e1 service nova] Creating event network-vif-plugged:da3fa7cd-644d-43c9-a049-2c30fdb50dce for instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 on hv-cinder-84605 Aug 24 12:39:02.897038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-fd59f5e1-646b-4b99-a01f-1511b99d1a65 req-af46f627-de31-43a3-b011-d04f729cd4e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056182 Aug 24 12:39:02.898035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 405/802] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:03.237677 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d1117a8-0f0c-43ba-b7b4-0fe9200b4d1c"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:03.240169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:03.247959 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.248573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.249199 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.250613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.251910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.252574 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.594424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-208d4713-e269-4822-a3f2-aa9fbce59c03 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360412 Aug 24 12:39:03.595542 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 398/803] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:39:03 2022] POST /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:03.715156 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:03.716307 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:03.729178 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.732967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.733601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.734759 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:03.735299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:03.735917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:03.921996 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:03.936341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:03.939963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:03.941552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7414fb85-f33d-452d-9461-f332a0fe4ec3 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.230764 Aug 24 12:39:03.954201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 406/804] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:03 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:04.971505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:04.972475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:04.988320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.988696 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.992413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:04.993508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:04.996498 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:04.998169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:05.203803 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:05.224327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:05.227308 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:05.228502 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0b2fca63-d5df-41b0-8595-1a6730e16ced tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.263597 Aug 24 12:39:05.230828 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 399/805] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:04 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:06.253631 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:06.254915 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:06.261728 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.262530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.263182 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.264279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:06.264937 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:06.265515 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:06.427256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:06.442734 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:06.444338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:06.445663 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fe72cb5b-c149-475d-9160-1630b39d71d5 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.196881 Aug 24 12:39:06.446480 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 407/806] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:06 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:07.479076 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:07.480378 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:07.495597 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.496223 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.497263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.498428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:07.499092 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:07.499716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:07.531400 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:07.691596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:07.702027 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:07.703526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:07.705304 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-011dd042-27a4-44ac-a7cc-42c1876d958d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.230632 Aug 24 12:39:07.722700 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 400/807] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:07 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:08.729638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:08.730267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:08.733145 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=60 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:08.740900 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.741700 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.742477 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.743525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:08.744793 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:08.748935 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:08.925593 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:08.935980 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:08.937521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:08.938920 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c25008a4-3b2d-4095-a956-87cc6bd1b32b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.213340 Aug 24 12:39:08.952675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 408/808] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:08 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:09.962857 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:09.964488 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:09.975977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.976817 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.977414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:09.978401 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:09.979046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:09.979662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:10.142546 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:10.152810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:10.154635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:10.156134 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a453ec16-e546-49e5-b717-b94bc5ed2948 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.197530 Aug 24 12:39:10.176046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 401/809] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:09 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:11.182143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.182708 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:11.191219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.191734 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.192157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.193054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.193361 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.193804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.312754 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.315483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:11.322256 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.322742 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.323180 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.323882 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.324337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.324788 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.335814 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:11.344700 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:11.346286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:11.347479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c60c7d97-6414-433a-8ec5-205779753cca tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1740 microversion: 2.20 time: 0.169507 Aug 24 12:39:11.348011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 409/810] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:11 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:11.356937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-896f01d0-3d43-4d91-ac63-6ac7dacdb70e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048759 Aug 24 12:39:11.357413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 402/811] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:11 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:39:11.367872 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:11.368329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:11.375174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.375676 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.376104 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.376839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:11.377295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:11.377718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:11.409941 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-007ed42f-7050-4f63-9db6-dd38462625e6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/3d1117a8-0f0c-43ba-b7b4-0fe9200b4d1c" status: 200 len: 194 microversion: 2.1 time: 0.045944 Aug 24 12:39:11.410518 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 410/812] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 24 12:39:11 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/3d1117a8-0f0c-43ba-b7b4-0fe9200b4d1c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:12.374153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:12.374724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:12.381564 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.382151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.382624 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.383377 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.383910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.384404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.537764 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:12.553484 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:12.556241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:12.558357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e4426c26-1cff-4385-8410-ded77d7ee9ce tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1722 microversion: 2.20 time: 0.188158 Aug 24 12:39:12.558916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 403/813] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:12 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:12.769211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "284e7608-470c-4d7f-89be-a1e4c56a3a6c"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:12.771541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:12.778297 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.778782 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.779242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:12.779938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:12.780382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:12.780837 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.583006 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:13.583716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:13.591430 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.591927 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.592360 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.593106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:13.593554 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:13.593982 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:13.738143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:13.748679 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:13.750418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:13.751818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7aa97470-1c5a-4de2-a647-c9a436bde072 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1722 microversion: 2.20 time: 0.172682 Aug 24 12:39:13.752546 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 404/814] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:13 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:14.061732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c9a945aa-2c48-431c-a14c-3464426b1dc1 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "POST /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.296351 Aug 24 12:39:14.062481 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 411/815] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:39:12 2022] POST /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments => generated 194 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:14.779825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:14.780365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:14.787303 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.787791 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.788222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.788947 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.789404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.789822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.936642 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:14.945030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:14.946502 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:14.947643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6efca9e9-71eb-498a-9a52-74159c52fdb7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1665 microversion: 2.20 time: 0.171933 Aug 24 12:39:14.948191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 405/816] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:14 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:14.970814 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f35d966-e29f-43fa-9661-e3a6967853fe"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:14.973363 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:14.980191 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.980569 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.981549 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:14.982272 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:14.982725 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:14.983151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.332521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2330193e-c84a-4ed7-b409-db90a3c9348e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.366458 Aug 24 12:39:15.333381 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 412/817] 10.222.0.27 () {62 vars in 1364 bytes} [Wed Aug 24 12:39:14 2022] POST /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/os-volume_attachments => generated 188 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 12:39:15.465572 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:15.466113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:15.473052 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.473676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.474050 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.475035 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.475813 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.476391 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.763813 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a545431e-d66f-4c7a-b13c-2a7f473a3160 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/os-volume_attachments/2f35d966-e29f-43fa-9661-e3a6967853fe" status: 202 len: 0 microversion: 2.20 time: 0.302226 Aug 24 12:39:15.764444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 406/818] 10.222.0.27 () {60 vars in 1457 bytes} [Wed Aug 24 12:39:15 2022] DELETE /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/os-volume_attachments/2f35d966-e29f-43fa-9661-e3a6967853fe => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:39:15.825970 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:15.826594 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:15.833696 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.834174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.834603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.835290 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.835748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.836145 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.867234 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127299) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 12:39:15.925064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:15.950486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-14b1662e-f27c-44dd-92ea-21db96d3ccbe tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "POST /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/action" status: 202 len: 0 microversion: 2.20 time: 0.128263 Aug 24 12:39:15.951090 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 413/819] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 24 12:39:15 2022] POST /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:39:15.959626 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:15.960225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:15.969670 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.970156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.971020 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:15.971281 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:15.971713 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:15.972131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:16.121255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:16.131307 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:16.132843 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:16.134017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b94303a7-93d0-4c79-94bc-43420bd78154 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1673 microversion: 2.20 time: 0.178548 Aug 24 12:39:16.134571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 407/820] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:15 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:16.817750 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-f1b62060-f388-4b88-b298-7288d077ca99 req-d20888af-a9d6-4908-9529-305327e3cb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "da3fa7cd-644d-43c9-a049-2c30fdb50dce"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:16.828983 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f1b62060-f388-4b88-b298-7288d077ca99 req-d20888af-a9d6-4908-9529-305327e3cb1d service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:16.829466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f1b62060-f388-4b88-b298-7288d077ca99 req-d20888af-a9d6-4908-9529-305327e3cb1d service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:16.830018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-f1b62060-f388-4b88-b298-7288d077ca99 req-d20888af-a9d6-4908-9529-305327e3cb1d service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:16.848284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.compute.server_external_events [req-f1b62060-f388-4b88-b298-7288d077ca99 req-d20888af-a9d6-4908-9529-305327e3cb1d service nova] Unable to find a host for instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8. Dropping event network-vif-unplugged {{(pid=127299) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 12:39:16.849207 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-f1b62060-f388-4b88-b298-7288d077ca99 req-d20888af-a9d6-4908-9529-305327e3cb1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038307 Aug 24 12:39:16.849939 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 414/821] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 12:39:17.161409 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:17.162418 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:17.173287 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:17.178577 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:17.179295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:17.180461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:17.181494 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:17.182191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:17.356204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:17.364884 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:17.366375 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:17.367525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-afc4054e-afc2-4ec3-9356-97166990f8f7 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1673 microversion: 2.20 time: 0.213576 Aug 24 12:39:17.368080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 408/822] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:17 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:18.391980 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:18.392622 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:18.399787 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:18.400334 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:18.400834 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:18.401631 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:18.402131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:18.402778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:18.537517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:18.546792 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:18.548274 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:18.549460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-084e91ac-d828-4899-953b-654081bd179d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.161767 Aug 24 12:39:18.550054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 415/823] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:18 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:19.573723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:19.575191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:19.582094 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:19.582576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:19.582965 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:19.583891 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:19.584336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:19.584783 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:19.728001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:19.737317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:19.739031 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:19.740280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e975eee7-3e81-4bb7-8812-17745bae1673 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.172198 Aug 24 12:39:19.741204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 409/824] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:19 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:20.764081 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:20.764986 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:20.772430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:20.772957 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:20.773392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:20.774105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:20.774559 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:20.774980 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:20.918578 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:20.928246 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:20.929758 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:20.930921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-230c891a-0d18-4aec-b117-f239311a7640 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.171630 Aug 24 12:39:20.931506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 416/825] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:20 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:21.956355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:21.956998 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:21.963872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:21.964358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:21.964944 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:21.966222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:21.966665 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:21.967095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:22.115843 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:22.126107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:22.127685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:22.128904 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ae25f56c-9fba-46ee-99dc-7bd10373b162 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.176655 Aug 24 12:39:22.130846 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 410/826] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:21 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:23.153983 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:23.155639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:23.165744 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:23.166370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:23.167001 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:23.168138 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:23.169276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:23.170078 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:23.316728 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:23.326937 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:23.328605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:23.330203 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1ba1aa43-7d75-4e21-a677-9a3f0e7b5276 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.181799 Aug 24 12:39:23.331096 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 417/827] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:23 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:24.359866 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:24.361939 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:24.372047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:24.372934 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:24.373621 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:24.374544 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:24.375222 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:24.375863 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:24.532285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:24.546560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:24.548081 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:24.549313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c893f9d8-fdb6-4893-96cd-4ac2ddc98c14 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.194838 Aug 24 12:39:24.550132 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 411/828] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:24 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:25.575217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:25.577241 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:25.584279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:25.584807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:25.585287 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:25.586012 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:25.586465 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:25.586889 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:25.734379 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:25.743884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:25.745465 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:25.746714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ea2db115-2a44-43f6-81b8-064c6dd9cf33 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.175716 Aug 24 12:39:25.747275 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 418/829] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:25 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:26.770128 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:26.770793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:26.773683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=40 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:26.779154 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:26.779864 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:26.780075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:26.781151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:26.781483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:26.782058 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:26.943641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:26.952907 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:26.954517 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:26.955757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-de311eca-9ba9-47e2-8ca1-6ef0d59c3408 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.189892 Aug 24 12:39:26.956406 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 412/830] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:26 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:27.982295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:27.983915 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:27.991616 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:27.992124 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:27.992554 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:27.993304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:27.993952 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:27.994372 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:28.143089 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:28.153797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:28.156329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:28.158102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6a04f98a-aa74-43ee-a7f9-0ea2b3d69556 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.182501 Aug 24 12:39:28.158892 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 419/831] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:27 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:29.188885 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:29.189911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:29.200189 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:29.200679 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:29.201143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:29.201840 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:29.202300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:29.202727 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:29.348873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:29.358227 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:29.359741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:29.360969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ca028f35-f13b-4e7d-a847-c2aa20e624fa tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.178767 Aug 24 12:39:29.361539 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 413/832] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:29 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:30.388826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:30.389422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:30.396273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:30.396803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:30.397240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:30.397944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:30.398401 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:30.398828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:30.541953 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:30.550873 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:30.552366 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:30.553562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d6db6959-cb21-407d-b8ac-fcda94a06ac2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.170122 Aug 24 12:39:30.554131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 420/833] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:30 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:31.581145 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:31.581757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:31.591505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:31.591984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:31.592413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:31.593247 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:31.593698 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:31.594113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:31.608907 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:31.739528 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:31.755952 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:31.757482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:31.758668 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f482c709-d564-4c29-821c-8cf6eddae974 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.183996 Aug 24 12:39:31.759243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 414/834] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:31 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:32.781939 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:32.782545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:32.789676 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:32.790157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:32.790652 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:32.791320 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:32.791770 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:32.792245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:32.935869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:32.944300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:32.945826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:32.947007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6d26aee5-7756-4b7b-bd82-04db0bc79112 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.169239 Aug 24 12:39:32.947592 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 421/835] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:32 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:33.971016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:33.971630 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:33.978641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:33.979135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:33.979900 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:33.980695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:33.981239 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:33.981712 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.116920 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:34.125600 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:34.127227 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:34.128408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-766f2ca9-79ca-46dd-8394-111a5cd49687 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.161668 Aug 24 12:39:34.129020 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 415/836] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:33 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:34.301383 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:34.302139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:34.311760 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:34.312470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:34.313142 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.314220 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:34.314780 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:34.315382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:34.341001 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2b80acb7-ef2d-4f88-baf7-ff040673ef78 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/ips" status: 200 len: 150 microversion: 2.1 time: 0.045107 Aug 24 12:39:34.341561 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 422/837] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 12:39:34 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:35.155600 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:35.156566 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:35.167394 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:35.167899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:35.168335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:35.169380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:35.169835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:35.170258 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:35.325177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:35.339209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:35.340724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:35.341889 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-592f84e0-2887-47b8-8f74-6fc5b0256a4f tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.192822 Aug 24 12:39:35.342461 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 416/838] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:35 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:36.366967 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:36.367845 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:36.376052 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:36.376541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:36.377039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:36.377746 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:36.378201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:36.378622 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:36.520541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:36.529569 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:36.531138 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:36.532343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5a023688-d853-47aa-a58e-0b5fa23e204b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.171094 Aug 24 12:39:36.532971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 423/839] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:36 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:37.559162 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:37.559767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:37.567053 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:37.567571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:37.568036 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:37.568825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:37.569310 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:37.569767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:37.707628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:37.716546 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:37.718191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:37.719347 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-658a8c29-33ab-4c41-9f5c-e2211b084f5a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.166266 Aug 24 12:39:37.719914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 417/840] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:37 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:38.746552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:38.747547 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:38.753308 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:38.759245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.760039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.760779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.761970 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:38.762421 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:38.762853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:38.912994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:38.923894 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:38.925424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:38.926725 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ef404f36-dedc-4577-b691-34dd56185369 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.186938 Aug 24 12:39:38.927279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 424/841] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:38 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:39.958224 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:39.958760 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:39.965637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:39.966109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:39.966541 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:39.967225 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:39.967670 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:39.968084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:40.114133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:40.122858 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:40.124470 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:40.125649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-94bb5d02-b9c5-44c2-b96f-432e175bdf4b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.171878 Aug 24 12:39:40.126501 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 418/842] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:39 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:41.001298 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f73ffa2-0908-48a6-83e2-dbaacb1471a0"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:41.003606 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:41.010555 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.011036 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.011461 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.012211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.012718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.013087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.148720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:41.149601 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:41.157370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.157998 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.158444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.159186 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:41.159681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:41.160257 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:41.297169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:41.305387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:41.306870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:41.308148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6b8d9ec4-50c8-4400-958c-b57730bacf7a tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.163376 Aug 24 12:39:41.309054 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 419/843] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:41 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:39:42.331710 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:42.334108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:42.345301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.345864 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.346300 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.347516 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:42.348055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:42.348618 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:42.498716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-50b2572d-c63d-4691-970b-5ab2f1bcceb0 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "POST /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.501517 Aug 24 12:39:42.499628 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 425/844] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 12:39:40 2022] POST /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments => generated 194 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:42.503145 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:42.512144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:42.514591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:42.516135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ede00339-2316-4d50-b3cc-3bfc620a2042 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.189036 Aug 24 12:39:42.518157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 420/845] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:42 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:43.020094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:43.022453 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:43.029046 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.029523 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.029952 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.030648 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.031096 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.031516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.062979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f1c84b44-3272-4200-bbe0-6f093242c81e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047773 Aug 24 12:39:43.063536 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 426/846] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:39:43 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:43.209932 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:43.210333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:43.217142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.217629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.218101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.218869 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.219335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.219763 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.252377 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-71b1cf44-d581-4993-a023-ac82da89d4c0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/3d1117a8-0f0c-43ba-b7b4-0fe9200b4d1c" status: 200 len: 194 microversion: 2.1 time: 0.046547 Aug 24 12:39:43.253012 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 421/847] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 24 12:39:43 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/3d1117a8-0f0c-43ba-b7b4-0fe9200b4d1c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:43.263921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:43.264413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:43.270891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.271378 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.271808 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.272493 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.273003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.273871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.373310 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lazy-loading 'services' on Instance uuid 35478048-ed82-46ca-af89-72f4f56abb58 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:39:43.481505 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-982330ed-e656-4436-bca5-2677b6e64b3e tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/3d1117a8-0f0c-43ba-b7b4-0fe9200b4d1c" status: 202 len: 0 microversion: 2.1 time: 0.221053 Aug 24 12:39:43.482031 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 427/848] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:39:43 2022] DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/3d1117a8-0f0c-43ba-b7b4-0fe9200b4d1c => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:39:43.543686 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:43.544893 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:43.551396 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.551878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.552385 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.553337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:43.553867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:43.554295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:43.704206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:43.716757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:43.718192 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:43.719339 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f8ea4615-4079-42b0-b2cb-98cc352d56c6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.182444 Aug 24 12:39:43.719900 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 422/849] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:43 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:44.742921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:44.743596 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:44.751958 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.752764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.753273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.753949 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:44.754607 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:44.755033 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:44.890341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:44.898618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:44.900113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:44.901313 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7f115f1b-9017-4f7d-821e-8dbcd3af68d1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.162592 Aug 24 12:39:44.901873 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 428/850] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:44 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:45.925435 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:45.926037 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:45.932875 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.933988 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.934413 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:45.935106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:45.935554 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:45.935968 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:46.079998 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:46.088557 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:46.090197 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:46.091363 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-959d73a8-d361-4252-a72a-12df80e2bfbc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.169861 Aug 24 12:39:46.091925 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 423/851] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:45 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:39:46.993481 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-29e7ecc9-2ff4-4aa6-a77e-b14fd9e736dd req-528dec38-ba06-4a8a-8730-82346774d68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8", "name": "network-vif-plugged", "status": "completed", "tag": "da3fa7cd-644d-43c9-a049-2c30fdb50dce"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:39:47.004959 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-29e7ecc9-2ff4-4aa6-a77e-b14fd9e736dd req-528dec38-ba06-4a8a-8730-82346774d68e service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.005599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-29e7ecc9-2ff4-4aa6-a77e-b14fd9e736dd req-528dec38-ba06-4a8a-8730-82346774d68e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.006091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-29e7ecc9-2ff4-4aa6-a77e-b14fd9e736dd req-528dec38-ba06-4a8a-8730-82346774d68e service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.010737 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:47.020543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-29e7ecc9-2ff4-4aa6-a77e-b14fd9e736dd req-528dec38-ba06-4a8a-8730-82346774d68e service nova] Creating event network-vif-plugged:da3fa7cd-644d-43c9-a049-2c30fdb50dce for instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 on hv-cinder-84605 Aug 24 12:39:47.025837 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-29e7ecc9-2ff4-4aa6-a77e-b14fd9e736dd req-528dec38-ba06-4a8a-8730-82346774d68e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036077 Aug 24 12:39:47.026831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 429/852] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:39:47.114506 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:47.115317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:47.122111 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.122726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.123278 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.124085 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:47.124641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:47.125210 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:47.280141 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:47.290679 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:47.294122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:47.296887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9f8edbbf-055a-4c9f-8dcd-c0acd56d245b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.186193 Aug 24 12:39:47.301776 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 424/853] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:47 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:48.324888 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:48.325989 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:48.334185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.334666 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.335162 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.335849 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:48.336291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:48.336738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:48.486150 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:48.498981 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:48.501366 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:48.503148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6a4505d5-17dc-4341-beec-b8b638a97570 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.185487 Aug 24 12:39:48.503900 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 430/854] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:48 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:49.530255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:49.530839 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:49.540548 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:49.541234 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:49.541810 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:49.543120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:49.543741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:49.544335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:49.685482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:49.693849 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:49.695347 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:49.696497 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5b987c3d-a9b7-457f-a7cc-da38ec9089c4 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.171117 Aug 24 12:39:49.697097 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 425/855] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:49 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:50.719791 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:50.720423 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:50.727385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:50.727869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:50.728299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:50.729001 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:50.729485 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:50.729905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:50.872476 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:50.881011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:50.882521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:50.883681 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-85595857-b674-4ef8-ab06-a09ffb6c8c40 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.167916 Aug 24 12:39:50.884250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 431/856] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:50 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:51.907829 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:51.908628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:51.915613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:51.916226 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:51.916733 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:51.917483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:51.918204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:51.918660 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:52.063869 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:52.074402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:52.076094 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:52.077467 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6443657f-e007-4fc6-9d75-6432c4794adf tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.173594 Aug 24 12:39:52.092676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 426/857] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:51 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:53.112161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:53.112738 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:53.120038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:53.120553 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:53.121039 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:53.121731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:53.122181 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:53.122601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:53.262468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:53.271105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:53.272611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:53.273775 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ab7d97c8-590f-4642-9d37-50fce26d7cdb tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.166011 Aug 24 12:39:53.274322 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 432/858] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:53 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:54.297439 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:54.298184 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:54.304928 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:54.305414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:54.305905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:54.306608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:54.307064 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:54.307480 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:54.449873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:54.458213 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:54.459716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:54.460943 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-98061cd3-43e5-4280-865b-05709f7d9284 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.167456 Aug 24 12:39:54.461499 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 427/859] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:54 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:39:55.494524 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:55.495159 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:55.502157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:55.502636 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:55.503059 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:55.503743 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:55.504184 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:55.504697 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:55.643165 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:55.651552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:55.653163 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:55.654315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f6663b25-1bd0-47f7-89f6-796a22ceb4ff tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.166211 Aug 24 12:39:55.654878 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 433/860] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:55 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:56.680242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:56.681000 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:56.688822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:56.689404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:56.689968 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:56.690787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:56.691317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:56.691837 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:56.840266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:56.848921 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:56.850432 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:56.851602 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ac50008a-aa14-4319-b646-63789177e49c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.176494 Aug 24 12:39:56.852167 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 428/861] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:56 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:57.875499 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:57.876079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:57.883005 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:57.883482 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:57.883927 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:57.884638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:57.885115 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:57.885538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:58.029399 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:58.037890 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:58.039464 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:58.040674 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-55fe69b8-e371-485f-807f-acc058d1333e tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.169259 Aug 24 12:39:58.041445 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 434/862] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:57 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:39:59.064326 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:39:59.065144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:39:59.067548 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=34 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:39:59.073130 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:59.074214 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:59.074343 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:59.075354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:39:59.075889 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:39:59.076402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:39:59.215960 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:59.224570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:59.226107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:39:59.227284 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-45e695f5-1b69-4f09-ace5-0d96866ac46d tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1731 microversion: 2.20 time: 0.166954 Aug 24 12:39:59.227859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 429/863] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:39:59 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:40:00.255448 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:00.256479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:00.267419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.268284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.269068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.270234 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.270974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.271667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.438399 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:00.447668 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:00.449635 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:00.450957 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-73e04760-b50f-4c39-b399-e763883e190b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1718 microversion: 2.20 time: 0.202473 Aug 24 12:40:00.451562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 435/864] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:40:00 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1718 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:40:00.811343 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:00.812172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:00.819010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.819505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.819936 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.820632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:00.821142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:00.821568 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:00.914352 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lazy-loading 'services' on Instance uuid eb76e27c-bcd8-4e62-94dd-fb4bb902db49 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:40:00.916487 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:00.999109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9dc5eca2-f079-4820-8aa9-b896f987d460 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments/1f73ffa2-0908-48a6-83e2-dbaacb1471a0" status: 202 len: 0 microversion: 2.1 time: 0.192083 Aug 24 12:40:00.999721 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 430/865] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:40:00 2022] DELETE /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments/1f73ffa2-0908-48a6-83e2-dbaacb1471a0 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:40:01.008227 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:01.010718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:01.017605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.018100 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.018802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.019520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.019976 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.020401 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.050921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9d1925ac-0ed4-49c8-85f5-cda3b3c0a28e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046710 Aug 24 12:40:01.051497 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 436/866] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:01 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:01.622109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:01.622688 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:01.629499 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.629985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.630422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.631121 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.631637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.633107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.665650 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-07594d6a-794f-43a3-93fc-193d9ee9c2ed tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/284e7608-470c-4d7f-89be-a1e4c56a3a6c" status: 200 len: 194 microversion: 2.1 time: 0.049717 Aug 24 12:40:01.666281 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 431/867] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 24 12:40:01 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/284e7608-470c-4d7f-89be-a1e4c56a3a6c => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:01.677661 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:01.678205 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:01.685295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.685777 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.686201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.686940 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:01.687385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:01.687797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:01.772263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lazy-loading 'services' on Instance uuid 35478048-ed82-46ca-af89-72f4f56abb58 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:40:01.860544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-631c710f-da3e-47c0-91a7-4da59c56e092 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/284e7608-470c-4d7f-89be-a1e4c56a3a6c" status: 202 len: 0 microversion: 2.1 time: 0.186595 Aug 24 12:40:01.861170 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 437/868] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 12:40:01 2022] DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments/284e7608-470c-4d7f-89be-a1e4c56a3a6c => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:40:02.063701 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:02.066239 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:02.073263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.074078 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.074525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.075229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:02.075688 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:02.076116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:02.106929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5e5171f1-573a-459d-8d86-ab0715eca869 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047452 Aug 24 12:40:02.107491 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 432/869] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:02 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:03.125646 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:03.128344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:03.136252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.136864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.137471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.138308 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.138853 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.139326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.173745 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3e251579-da54-4f80-b49b-64551801db3e tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053790 Aug 24 12:40:03.174464 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 438/870] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:03 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:40:03.238191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:03.238861 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:03.246348 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.246835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.247285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.247999 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.248454 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.248925 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.277683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:40:03.359097 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f8e6b765-ea22-4e72-baa4-72c3430923ff tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 204 len: 0 microversion: 2.1 time: 0.124609 Aug 24 12:40:03.359737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 433/871] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:03 2022] DELETE /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:40:03.368315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:03.368947 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:03.375199 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.375671 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.376101 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.376820 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:03.377282 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:03.377688 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:03.522635 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:03.530800 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ea7189f6-e479-4525-a37e-31f0ae01211b tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1682 microversion: 2.1 time: 0.166281 Aug 24 12:40:03.531362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 439/872] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:03 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:04.112556 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.114902 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.121965 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.122451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.122892 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.123587 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.124046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.124474 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.161629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a7fd4398-7664-4ec4-b8c9-4456aced7860 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053044 Aug 24 12:40:04.162384 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 434/873] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:04 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:40:04.290276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.292899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.299993 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.300473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.300933 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.301655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.302100 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.302519 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.332065 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-91003441-89ef-4af6-b09d-d753db8e03d0 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045789 Aug 24 12:40:04.332620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 440/874] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 12:40:04 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 12:40:04.393793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.394334 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.401307 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.401782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.402215 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.403045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.403501 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.403915 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.429746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:40:04.511366 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d4ea634a-1376-4c5b-8d4a-bcca32b6f634 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 204 len: 0 microversion: 2.1 time: 0.121050 Aug 24 12:40:04.511838 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 435/875] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:04 2022] DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:40:04.520219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.520938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.526984 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.527470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.527899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.528593 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.529068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.529483 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.553484 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:04.554178 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:04.560939 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.561519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.562072 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.562656 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:04.563111 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:04.563535 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:04.713734 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:04.721720 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-adcea63e-bc8c-4695-a7c1-8891d4074ed2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1671 microversion: 2.1 time: 0.205294 Aug 24 12:40:04.722252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 441/876] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:04 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:04.742423 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:04.752160 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-64ce2e4c-f4af-4926-bce1-9a3639797597 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1682 microversion: 2.1 time: 0.203056 Aug 24 12:40:04.752770 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 436/877] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:04 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:05.748523 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:05.749536 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:05.760820 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.761314 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.761753 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.762443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.762880 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.763300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.774046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:05.774662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:05.781652 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.782150 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.782586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.783295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:05.783764 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:05.784169 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:05.971643 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:05.979573 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:05.980759 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-48a98124-0451-4297-9547-bdb06daeccbb tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1671 microversion: 2.1 time: 0.238576 Aug 24 12:40:05.981242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 442/878] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:05 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1671 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:05.989200 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-61b868ed-b237-431b-aeb1-3c4d2339d1b6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1682 microversion: 2.1 time: 0.219025 Aug 24 12:40:05.989752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 437/879] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:05 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:07.004932 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:07.005788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:07.010193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:07.011236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:07.012743 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.013271 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.013705 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.014406 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.014847 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.015281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.017467 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.017945 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.018380 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.019075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:07.019531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:07.019940 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:07.660824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:07.669479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ecb8988c-d195-45ea-8241-3273c5847650 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1671 microversion: 2.1 time: 0.670062 Aug 24 12:40:07.670049 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 443/880] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:06 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1671 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:07.687612 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:07.695776 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-84a203a5-d60b-4294-a300-f8c6e202ed4a tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1682 microversion: 2.1 time: 0.689345 Aug 24 12:40:07.696414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 438/881] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:07 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1682 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:08.691458 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:08.692029 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:08.699854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.700810 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.701268 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.702048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.702529 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.702976 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.718567 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:08.719149 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:08.731299 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.731786 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.732218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.732948 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:08.733407 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:08.733815 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:08.888467 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d8138d44bc40dd8f63ee4916ffbce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fea11cfdd748bab1cdea46b073dc89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:08.896195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a617fc13534a89ad50a5fdc7bf769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75590a43f50b48699fc0d5a892a99544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:08.899507 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-494ee5e0-504e-4927-8012-60c784ca51e2 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 200 len: 1603 microversion: 2.1 time: 0.212208 Aug 24 12:40:08.905240 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-55ab9a1b-974a-49f6-b257-6eff10137e5d tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 200 len: 1614 microversion: 2.1 time: 0.190830 Aug 24 12:40:08.915408 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 444/882] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:08 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 1603 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:08.920139 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 439/883] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:08 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 1614 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:40:09.061041 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-15a31161-5fb7-4ea2-878c-37ce941980a4 req-cc751472-a3a7-4cb4-af1a-faa6bffefab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb76e27c-bcd8-4e62-94dd-fb4bb902db49", "name": "network-vif-deleted", "tag": "ddeb7a47-d3ed-4c4b-b0e0-388768a83c40"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:09.074690 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=41 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:09.077745 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-15a31161-5fb7-4ea2-878c-37ce941980a4 req-cc751472-a3a7-4cb4-af1a-faa6bffefab3 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.079440 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-15a31161-5fb7-4ea2-878c-37ce941980a4 req-cc751472-a3a7-4cb4-af1a-faa6bffefab3 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.079978 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-15a31161-5fb7-4ea2-878c-37ce941980a4 req-cc751472-a3a7-4cb4-af1a-faa6bffefab3 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.097227 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-15a31161-5fb7-4ea2-878c-37ce941980a4 req-cc751472-a3a7-4cb4-af1a-faa6bffefab3 service nova] Creating event network-vif-deleted:ddeb7a47-d3ed-4c4b-b0e0-388768a83c40 for instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 on hv-cinder-84605 Aug 24 12:40:09.103215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-15a31161-5fb7-4ea2-878c-37ce941980a4 req-cc751472-a3a7-4cb4-af1a-faa6bffefab3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046400 Aug 24 12:40:09.104375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 445/884] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:40:09.927179 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:09.929297 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:09.930959 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:09.932140 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:09.947134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.947324 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.948608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.949134 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.950605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.951424 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.952449 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.953221 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.955454 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.955809 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:09.958838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:09.959362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:09.977355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] HTTP exception thrown: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Request method failure captured: Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 HTTP/1.1 Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhpvqu6ZF6PkXWPDcapqqQvdTnqkmK6s_NkUrIk3Kc72IrZCMggWnsIWy115rWAy2HtqmkzDVz2spWheoJgOv2HbH4krQgeCZjl5hkVRLaD1jeJBYAtwnhZraScFr4ViTGE2_OXE3RgIeKfx1RH_KCVVWIHuDRvJd1ggbpvpAF9U1Fo Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:09.979398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}] Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 85d8138d44bc40dd8f63ee4916ffbce9 Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:09.981126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '35478048-ed82-46ca-af89-72f4f56abb58'} Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:09.981970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:09.984010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 HTTP/1.1 Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:09.985470 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:09.986871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': 'eb76e27c-bcd8-4e62-94dd-fb4bb902db49'} Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:09.987639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:09.988974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:09.990254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:09.990254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-97ad1908-3cf6-4048-8f01-1934501d55c5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 404 len: 111 microversion: 2.1 time: 0.060819 Aug 24 12:40:09.990254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 446/885] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:09 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:09.991513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Returning 404 to user: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:09.992497 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bf1b3e71-686d-4e1c-b81a-b6235e9cee69 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 404 len: 111 microversion: 2.1 time: 0.072751 Aug 24 12:40:09.993421 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 440/886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:09 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:09.997803 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-705b87f6-14d7-4384-a4f5-f63139e15507 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '.version_select at 0x7fa676c14af0>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:10.002488 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-269a774e-8a2a-4479-bef3-5f2e2ccc27cc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '.version_select at 0x7fa676ba5b80>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:10.026829 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-269a774e-8a2a-4479-bef3-5f2e2ccc27cc tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-384769707" status: 202 len: 0 microversion: 2.1 time: 0.028549 Aug 24 12:40:10.027509 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 441/887] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Aug 24 12:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-384769707 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:40:10.028381 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-705b87f6-14d7-4384-a4f5-f63139e15507 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602405780" status: 202 len: 0 microversion: 2.1 time: 0.038451 Aug 24 12:40:10.029525 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 447/888] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 12:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602405780 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:40:11.120916 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-6ed1feb6-6d57-4970-aedd-f2104fd2ccbe req-94a14bf1-6221-4fa5-a00b-56e76e1adb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35478048-ed82-46ca-af89-72f4f56abb58", "name": "network-vif-deleted", "tag": "4002fdef-db85-47a2-aecc-5abe1e61a01b"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:11.130994 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-6ed1feb6-6d57-4970-aedd-f2104fd2ccbe req-94a14bf1-6221-4fa5-a00b-56e76e1adb1a service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.131508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-6ed1feb6-6d57-4970-aedd-f2104fd2ccbe req-94a14bf1-6221-4fa5-a00b-56e76e1adb1a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.131945 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-6ed1feb6-6d57-4970-aedd-f2104fd2ccbe req-94a14bf1-6221-4fa5-a00b-56e76e1adb1a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.142695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-6ed1feb6-6d57-4970-aedd-f2104fd2ccbe req-94a14bf1-6221-4fa5-a00b-56e76e1adb1a service nova] Creating event network-vif-deleted:4002fdef-db85-47a2-aecc-5abe1e61a01b for instance 35478048-ed82-46ca-af89-72f4f56abb58 on hv-cinder-84605 Aug 24 12:40:11.148061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-6ed1feb6-6d57-4970-aedd-f2104fd2ccbe req-94a14bf1-6221-4fa5-a00b-56e76e1adb1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031475 Aug 24 12:40:11.148660 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 442/889] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:40:11.906028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:11.906721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:11.913463 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.913966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.914382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.915073 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.915526 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.915947 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.919190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:11.931691 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 HTTP/1.1 Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:11.933468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.934944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': 'eb76e27c-bcd8-4e62-94dd-fb4bb902db49'} Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:11.935732 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.936966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.938144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:11.938144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e5f4b009-7cc1-4abb-bae6-20b80f703ba7 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 404 len: 111 microversion: 2.1 time: 0.033874 Aug 24 12:40:11.938144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 448/890] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:11 2022] DELETE /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:11.945977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:11.946685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: eb76e27c-bcd8-4e62-94dd-fb4bb902db49] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:11.953708 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.954202 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.954661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.955301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:11.955755 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:11.956177 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:11.971147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 HTTP/1.1 Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:11.973301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.974669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': 'eb76e27c-bcd8-4e62-94dd-fb4bb902db49'} Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:11.975381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. Aug 24 12:40:11.976583 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:11.978511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance eb76e27c-bcd8-4e62-94dd-fb4bb902db49 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:11.978511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-550ae869-7e27-434e-baed-eeeb31817663 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49" status: 404 len: 111 microversion: 2.1 time: 0.033073 Aug 24 12:40:11.978511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 443/891] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:11 2022] GET /compute/v2.1/servers/eb76e27c-bcd8-4e62-94dd-fb4bb902db49 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:13.015442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.015930 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.022733 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.023212 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.023642 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.024329 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.024813 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.025232 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.038883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] HTTP exception thrown: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Request method failure captured: Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 HTTP/1.1 Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhpvqu6ZF6PkXWPDcapqqQvdTnqkmK6s_NkUrIk3Kc72IrZCMggWnsIWy115rWAy2HtqmkzDVz2spWheoJgOv2HbH4krQgeCZjl5hkVRLaD1jeJBYAtwnhZraScFr4ViTGE2_OXE3RgIeKfx1RH_KCVVWIHuDRvJd1ggbpvpAF9U1Fo Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:13.040405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}] Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 85d8138d44bc40dd8f63ee4916ffbce9 Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.042118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '35478048-ed82-46ca-af89-72f4f56abb58'} Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:13.042975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.044521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.046131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Returning 404 to user: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:13.046131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-08af0eab-6cbb-4aaa-91d6-5edf3643423a tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 404 len: 111 microversion: 2.1 time: 0.030939 Aug 24 12:40:13.046131 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 449/892] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:13 2022] DELETE /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:13.050716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.051351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 35478048-ed82-46ca-af89-72f4f56abb58] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.058155 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.058649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.059073 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.059757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.060204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.060625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.073922 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] HTTP exception thrown: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Request method failure captured: Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 HTTP/1.1 Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhpvqu6ZF6PkXWPDcapqqQvdTnqkmK6s_NkUrIk3Kc72IrZCMggWnsIWy115rWAy2HtqmkzDVz2spWheoJgOv2HbH4krQgeCZjl5hkVRLaD1jeJBYAtwnhZraScFr4ViTGE2_OXE3RgIeKfx1RH_KCVVWIHuDRvJd1ggbpvpAF9U1Fo Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:13.075648 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}] Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 85d8138d44bc40dd8f63ee4916ffbce9 Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.077268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '35478048-ed82-46ca-af89-72f4f56abb58'} Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:13.078399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. Aug 24 12:40:13.079855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.081899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Returning 404 to user: Instance 35478048-ed82-46ca-af89-72f4f56abb58 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:13.081899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5c47cacb-a64b-4c89-912d-c29ecb2708b6 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58" status: 404 len: 111 microversion: 2.1 time: 0.030192 Aug 24 12:40:13.081899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 444/893] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:13 2022] GET /compute/v2.1/servers/35478048-ed82-46ca-af89-72f4f56abb58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:13.125509 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.126007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.132372 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.132904 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.133364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.134315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.134903 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.135347 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.150075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 HTTP/1.1 Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:13.151828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.153693 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': 'e224a672-083c-40d5-a171-d4d92b90ee52'} Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:13.154826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.156577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.158256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:13.158256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-35debd32-ae19-472d-a647-ec16eb5292e9 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 404 len: 111 microversion: 2.1 time: 0.032154 Aug 24 12:40:13.158256 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 450/894] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:13 2022] DELETE /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:13.162721 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.163345 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: e224a672-083c-40d5-a171-d4d92b90ee52] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.169821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.170309 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.170728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.171436 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.171903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.172324 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.186388 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 HTTP/1.1 Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:13.188056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.189639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': 'e224a672-083c-40d5-a171-d4d92b90ee52'} Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:13.190475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. Aug 24 12:40:13.191910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.192984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance e224a672-083c-40d5-a171-d4d92b90ee52 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:13.192984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ca134d65-43e0-4d35-9f29-04cbcee3b356 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52" status: 404 len: 111 microversion: 2.1 time: 0.030944 Aug 24 12:40:13.192984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 445/895] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:13 2022] GET /compute/v2.1/servers/e224a672-083c-40d5-a171-d4d92b90ee52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:13.198918 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.199460 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.205818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.206398 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.206917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.207627 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.208078 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.208496 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.222809 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a HTTP/1.1 Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:13.224424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.226204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': 'd1d90b9b-40b9-4bdd-981a-cd8c18281f3a'} Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:13.227068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.228255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.229778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:13.229778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bbdce5a6-30f5-4cff-af80-81d882070323 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 404 len: 111 microversion: 2.1 time: 0.031528 Aug 24 12:40:13.229778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 451/896] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:13 2022] DELETE /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:13.234848 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:13.235439 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: d1d90b9b-40b9-4bdd-981a-cd8c18281f3a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:13.241602 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.242084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.242518 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.243202 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:13.243655 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:13.244074 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:13.258886 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a HTTP/1.1 Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:13.260412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.262195 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': 'd1d90b9b-40b9-4bdd-981a-cd8c18281f3a'} Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:13.263276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. Aug 24 12:40:13.265367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:13.267042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance d1d90b9b-40b9-4bdd-981a-cd8c18281f3a could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:13.267042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b9159e78-d28f-4420-ab71-ddc5b91554a6 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a" status: 404 len: 111 microversion: 2.1 time: 0.030981 Aug 24 12:40:13.267042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 446/897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:13 2022] GET /compute/v2.1/servers/d1d90b9b-40b9-4bdd-981a-cd8c18281f3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:14.246650 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.247188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.254013 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.254471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.254922 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.255609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.256052 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.256463 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.271825 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] HTTP exception thrown: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Request method failure captured: Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 HTTP/1.1 Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhpvqu6ZF6PkXWPDcapqqQvdTnqkmK6s_NkUrIk3Kc72IrZCMggWnsIWy115rWAy2HtqmkzDVz2spWheoJgOv2HbH4krQgeCZjl5hkVRLaD1jeJBYAtwnhZraScFr4ViTGE2_OXE3RgIeKfx1RH_KCVVWIHuDRvJd1ggbpvpAF9U1Fo Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:14.273414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}] Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 85d8138d44bc40dd8f63ee4916ffbce9 Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.275007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '0c0c5601-af7b-4464-a37d-63b475832ae5'} Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:14.275891 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.278105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.279701 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Returning 404 to user: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:14.279701 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-875dfe53-2d0d-44de-babe-df6bb1b5ab4f tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 404 len: 111 microversion: 2.1 time: 0.032786 Aug 24 12:40:14.279701 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 452/898] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:14 2022] DELETE /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:14.283811 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.284427 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] [instance: 0c0c5601-af7b-4464-a37d-63b475832ae5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.291634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.292137 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.292575 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.293273 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.293714 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.294131 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.308412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] HTTP exception thrown: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Request method failure captured: Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 HTTP/1.1 Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhpvqu6ZF6PkXWPDcapqqQvdTnqkmK6s_NkUrIk3Kc72IrZCMggWnsIWy115rWAy2HtqmkzDVz2spWheoJgOv2HbH4krQgeCZjl5hkVRLaD1jeJBYAtwnhZraScFr4ViTGE2_OXE3RgIeKfx1RH_KCVVWIHuDRvJd1ggbpvpAF9U1Fo Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:14.310065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96fea11cfdd748bab1cdea46b073dc89"}]}] Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 96fea11cfdd748bab1cdea46b073dc89 Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-420593932 Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 85d8138d44bc40dd8f63ee4916ffbce9 Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeTestJSON-420593932-project Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.311641 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '0c0c5601-af7b-4464-a37d-63b475832ae5'} Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:14.312452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. Aug 24 12:40:14.313967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.315313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] Returning 404 to user: Instance 0c0c5601-af7b-4464-a37d-63b475832ae5 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:14.315313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f507733f-ba2d-49fd-96a0-3eab30c00593 tempest-AttachVolumeTestJSON-420593932 tempest-AttachVolumeTestJSON-420593932-project] 10.222.0.27 "GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5" status: 404 len: 111 microversion: 2.1 time: 0.031744 Aug 24 12:40:14.315313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 447/899] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:14 2022] GET /compute/v2.1/servers/0c0c5601-af7b-4464-a37d-63b475832ae5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:14.416807 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.417307 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.423490 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.423932 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.424519 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.425347 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.425796 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.426207 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.439801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 HTTP/1.1 Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:14.441349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.442778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '056ae6fc-add8-4682-ad3d-ab4072db60f5'} Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:14.443506 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.444764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.446067 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:14.446067 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ba9b6d9d-54bc-49c4-be20-27413e3158dc tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 404 len: 111 microversion: 2.1 time: 0.030238 Aug 24 12:40:14.446067 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 453/900] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:40:14 2022] DELETE /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:14.451809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:14.452670 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] [instance: 056ae6fc-add8-4682-ad3d-ab4072db60f5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:14.458956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.459628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.460078 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.460855 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:14.461312 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:14.461743 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:14.476125 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] HTTP exception thrown: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Request method failure captured: Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 HTTP/1.1 Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhp3DIkyl5tnpL76jcxvYgxORmGiil3sXxoHRkux-bNG9j2en_f2-Rfhp7wKrR_cqH2BHAOinrjeNa094UushIBHwbiqTYYt3IIG4WvOBiEDGHgiHF6UBvwAXI_3SdBhnP-YDqDj-HKGfAHV-LKaGo_8O3RrTNB2GPigAS8zvGdcfyo Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:14.477775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75590a43f50b48699fc0d5a892a99544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75590a43f50b48699fc0d5a892a99544"}]}] Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 75590a43f50b48699fc0d5a892a99544 Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1277555472 Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: b4a617fc13534a89ad50a5fdc7bf769a Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1277555472-project Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.479595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '056ae6fc-add8-4682-ad3d-ab4072db60f5'} Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:14.480581 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. Aug 24 12:40:14.482032 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:14.483315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] Returning 404 to user: Instance 056ae6fc-add8-4682-ad3d-ab4072db60f5 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:14.483315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-eefb936d-5fd3-494f-a099-37ee1f576bb5 tempest-AttachVolumeNegativeTest-1277555472 tempest-AttachVolumeNegativeTest-1277555472-project] 10.222.0.27 "GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5" status: 404 len: 111 microversion: 2.1 time: 0.031407 Aug 24 12:40:14.483315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 448/901] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:14 2022] GET /compute/v2.1/servers/056ae6fc-add8-4682-ad3d-ab4072db60f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:40:26.427991 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:26.428848 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=11 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:26.437580 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.439855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.448752 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.449438 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.453885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.453885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.453885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.453885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.483339 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-53ae4b31-30c4-4e29-978d-8c072520a3a2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056605 Aug 24 12:40:26.483955 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 454/902] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 12:40:26 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:40:26.548841 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.549555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.552371 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:26.553030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:26.559608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.560094 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.560547 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.561263 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.561707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.562127 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.591726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:40:26.675284 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-754636c1-4137-45ca-97c9-e43412830f3c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 204 len: 0 microversion: 2.20 time: 0.130211 Aug 24 12:40:26.675971 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 449/903] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 24 12:40:26 2022] DELETE /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:40:26.685827 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:26.686428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:26.692827 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.693305 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.693727 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.694399 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:26.694846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:26.695264 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:26.829895 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:26.838537 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:26.840103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:26.841290 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-47a6de5d-7038-481b-94d3-777f3b93a4cc tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.159878 Aug 24 12:40:26.841843 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 455/904] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:40:26 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 12:40:27.864496 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:27.865229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:27.872003 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:27.872494 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:27.872957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:27.873661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:27.874108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:27.874725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:28.024730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:28.033505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:28.035093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:28.036328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c498e79a-7add-471a-bfc3-13bccfa30b55 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1724 microversion: 2.20 time: 0.176353 Aug 24 12:40:28.037261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 450/905] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:40:27 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:40:29.061428 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:29.062605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:29.069277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.070003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.070444 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.071143 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.071749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.072388 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.220156 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:29.230043 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:29.237583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:29.237583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-36c2570e-8a14-4173-93c8-53bde51df7e2 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1656 microversion: 2.20 time: 0.175297 Aug 24 12:40:29.247377 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 456/906] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:40:29 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1656 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:40:29.747685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-0e21e0d7-d9ae-4bfb-baa5-606df40da6aa req-f5dba70a-3c5c-4ce7-aa9c-2ce8f64266ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8", "name": "network-vif-deleted", "tag": "da3fa7cd-644d-43c9-a049-2c30fdb50dce"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:29.759544 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0e21e0d7-d9ae-4bfb-baa5-606df40da6aa req-f5dba70a-3c5c-4ce7-aa9c-2ce8f64266ae service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:29.760434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0e21e0d7-d9ae-4bfb-baa5-606df40da6aa req-f5dba70a-3c5c-4ce7-aa9c-2ce8f64266ae service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:29.772034 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0e21e0d7-d9ae-4bfb-baa5-606df40da6aa req-f5dba70a-3c5c-4ce7-aa9c-2ce8f64266ae service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:29.786542 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-0e21e0d7-d9ae-4bfb-baa5-606df40da6aa req-f5dba70a-3c5c-4ce7-aa9c-2ce8f64266ae service nova] Creating event network-vif-deleted:da3fa7cd-644d-43c9-a049-2c30fdb50dce for instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 on hv-cinder-84605 Aug 24 12:40:29.792937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-0e21e0d7-d9ae-4bfb-baa5-606df40da6aa req-f5dba70a-3c5c-4ce7-aa9c-2ce8f64266ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049331 Aug 24 12:40:29.793768 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 451/907] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:40:30.255651 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:30.256210 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:30.264712 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.266032 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.267237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.268550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.269437 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.269961 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.312122 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:30.312783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:30.313530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:30.314240 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lazy-loading 'fault' on Instance uuid 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:40:30.367527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:30.380171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:30.381943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd39206c155f4e1cb9f7f90fb5a10556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9095a2f3c7d946a2b017115364dc6753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:30.383425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bb6457f0-2437-4229-ad54-8795e5b5989b tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 200 len: 1372 microversion: 2.20 time: 0.131603 Aug 24 12:40:30.383972 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 457/908] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:40:30 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 12:40:31.407542 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:31.408214 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:31.422024 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.422856 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.423291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.424191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:31.425038 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:31.425571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:31.446059 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] HTTP exception thrown: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Request method failure captured: Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 HTTP/1.1 Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhrHpfZ5WvZXf5iogDbpOHllFPK_nl2GSk9Y_O6lwhFUQJWkkwIJtZotiTD-6Lqwb_7PokyWW8Egyga_3YX7JgQLKK-Bpdj4YaAiZQUmGgt998AT29k9IQv_ktDRQBJudZlPtLPM1DQtM6Fibq6Fe4Ms00Dj_KHLMLpsJTfj6m193ik Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:31.448355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}] Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: fd39206c155f4e1cb9f7f90fb5a10556 Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:31.450816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8'} Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:31.452040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:31.453614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:31.455806 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Returning 404 to user: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:31.455806 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0c3c94a2-e798-42ea-8a35-10ea91df8215 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 404 len: 111 microversion: 2.20 time: 0.047085 Aug 24 12:40:31.455806 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 452/909] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:40:31 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:40:31.459299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b4964446-179f-491f-8c43-05474311dab1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '.version_select at 0x7fa676c26e50>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:31.479624 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b4964446-179f-491f-8c43-05474311dab1 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314085783" status: 204 len: 0 microversion: 2.20 time: 0.024426 Aug 24 12:40:31.480239 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 458/910] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Aug 24 12:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314085783 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 12:40:33.343007 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:33.343519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:33.350057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.350550 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.351021 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.351720 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.352178 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.352615 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.367329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] HTTP exception thrown: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Request method failure captured: Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 HTTP/1.1 Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhrHpfZ5WvZXf5iogDbpOHllFPK_nl2GSk9Y_O6lwhFUQJWkkwIJtZotiTD-6Lqwb_7PokyWW8Egyga_3YX7JgQLKK-Bpdj4YaAiZQUmGgt998AT29k9IQv_ktDRQBJudZlPtLPM1DQtM6Fibq6Fe4Ms00Dj_KHLMLpsJTfj6m193ik Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:33.369014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}] Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: fd39206c155f4e1cb9f7f90fb5a10556 Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.370887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8'} Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:33.371771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.373235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.374591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Returning 404 to user: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:33.374591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9cbab959-3419-4419-8372-6b94a0e16bde tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 404 len: 111 microversion: 2.20 time: 0.031573 Aug 24 12:40:33.374591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 453/911] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 24 12:40:33 2022] DELETE /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:40:33.379929 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:33.380540 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:33.387431 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.387914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.388344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.389079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:33.389527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:33.389944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:33.403736 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] HTTP exception thrown: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Request method failure captured: Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 HTTP/1.1 Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhrHpfZ5WvZXf5iogDbpOHllFPK_nl2GSk9Y_O6lwhFUQJWkkwIJtZotiTD-6Lqwb_7PokyWW8Egyga_3YX7JgQLKK-Bpdj4YaAiZQUmGgt998AT29k9IQv_ktDRQBJudZlPtLPM1DQtM6Fibq6Fe4Ms00Dj_KHLMLpsJTfj6m193ik Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:33.405385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}] Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: fd39206c155f4e1cb9f7f90fb5a10556 Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.408292 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8'} Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:33.409831 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. Aug 24 12:40:33.412044 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:33.414609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Returning 404 to user: Instance 1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:33.414609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1f0ff54f-82d4-43dd-a63d-8dca82b81066 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8" status: 404 len: 111 microversion: 2.20 time: 0.031248 Aug 24 12:40:33.414609 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 459/912] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:40:33 2022] GET /compute/v2.1/servers/1ddf450a-c8c0-4e3a-b02e-2c0a0b117eb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:40:34.565399 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:34.566126 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:34.574362 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.575058 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.575595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.576398 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.582320 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.582823 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.598475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] HTTP exception thrown: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Request method failure captured: Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a HTTP/1.1 Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhrHpfZ5WvZXf5iogDbpOHllFPK_nl2GSk9Y_O6lwhFUQJWkkwIJtZotiTD-6Lqwb_7PokyWW8Egyga_3YX7JgQLKK-Bpdj4YaAiZQUmGgt998AT29k9IQv_ktDRQBJudZlPtLPM1DQtM6Fibq6Fe4Ms00Dj_KHLMLpsJTfj6m193ik Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:40:34.600204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}] Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: fd39206c155f4e1cb9f7f90fb5a10556 Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.602153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '6ac6a7ad-e418-48a8-8e4b-a1449c35183a'} Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:34.603367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.605133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.606707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Returning 404 to user: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:34.606707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ff34d2f0-dfc5-4a27-a740-dab58ff7430c tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 404 len: 111 microversion: 2.20 time: 0.041309 Aug 24 12:40:34.606707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 454/913] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 24 12:40:34 2022] DELETE /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:40:34.612056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:34.612679 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] [instance: 6ac6a7ad-e418-48a8-8e4b-a1449c35183a] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:34.619336 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.620029 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.620457 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.621374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:34.621818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:34.622396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:34.636613 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] HTTP exception thrown: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Request method failure captured: Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a HTTP/1.1 Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhrHpfZ5WvZXf5iogDbpOHllFPK_nl2GSk9Y_O6lwhFUQJWkkwIJtZotiTD-6Lqwb_7PokyWW8Egyga_3YX7JgQLKK-Bpdj4YaAiZQUmGgt998AT29k9IQv_ktDRQBJudZlPtLPM1DQtM6Fibq6Fe4Ms00Dj_KHLMLpsJTfj6m193ik Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:40:34.638721 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9095a2f3c7d946a2b017115364dc6753"}]}] Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 9095a2f3c7d946a2b017115364dc6753 Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966531878 Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: fd39206c155f4e1cb9f7f90fb5a10556 Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966531878-project Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.640109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '6ac6a7ad-e418-48a8-8e4b-a1449c35183a'} Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:40:34.644924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. Aug 24 12:40:34.647350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:40:34.648779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] Returning 404 to user: Instance 6ac6a7ad-e418-48a8-8e4b-a1449c35183a could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:40:34.648779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e4b8c0e2-4aa8-47b6-8261-bad6937112b6 tempest-AttachVolumeShelveTestJSON-966531878 tempest-AttachVolumeShelveTestJSON-966531878-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a" status: 404 len: 111 microversion: 2.20 time: 0.032127 Aug 24 12:40:34.648779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 460/914] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 12:40:34 2022] GET /compute/v2.1/servers/6ac6a7ad-e418-48a8-8e4b-a1449c35183a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 12:40:58.911903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-535387421", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "networks": [{"uuid": "6c6d6000-ecbf-4c0c-8d0e-6f7676e46287"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:40:58.923749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:58.924385 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:58.972959 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] validate_networks() for [('6c6d6000-ecbf-4c0c-8d0e-6f7676e46287', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:40:59.348219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:40:59.349080 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:40:59.349736 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:40:59.350275 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:40:59.350768 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:40:59.363687 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:59.364172 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:59.364609 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:59.365402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:40:59.365871 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:40:59.366286 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:40:59.383694 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Getting quotas for project 121d2511f42847cab3930da359a3a7ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:40:59.387833 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Getting quotas for user 85620ae3c59a44da898ec76436271027 and project 121d2511f42847cab3930da359a3a7ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:40:59.398818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:40:59.401140 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:40:59.449377 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9e58702d-69b5-42cf-9c8d-454e4840296a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543895 Aug 24 12:40:59.450022 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 455/915] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:40:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:40:59.461136 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0f2dc9fe-3780-4d76-8cdc-683e655f8904 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:40:59.461766 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0f2dc9fe-3780-4d76-8cdc-683e655f8904 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:40:59.464118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:59.464781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=30 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:40:59.526640 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0f2dc9fe-3780-4d76-8cdc-683e655f8904 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:40:59.538841 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0f2dc9fe-3780-4d76-8cdc-683e655f8904 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1213 microversion: 2.1 time: 0.080968 Aug 24 12:40:59.539786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 461/916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:40:59 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:00.567359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f1b5d7e7-ba7d-4c7a-9b64-9cd1f005888a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:00.568329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f1b5d7e7-ba7d-4c7a-9b64-9cd1f005888a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:00.622030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f1b5d7e7-ba7d-4c7a-9b64-9cd1f005888a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:00.629071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f1b5d7e7-ba7d-4c7a-9b64-9cd1f005888a tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1213 microversion: 2.1 time: 0.068674 Aug 24 12:41:00.629665 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 456/917] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:00 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:01.649370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bbbebd77-4b68-4560-a627-aa1b3a9966da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:01.650164 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bbbebd77-4b68-4560-a627-aa1b3a9966da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:01.707151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bbbebd77-4b68-4560-a627-aa1b3a9966da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:01.714383 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bbbebd77-4b68-4560-a627-aa1b3a9966da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1213 microversion: 2.1 time: 0.068944 Aug 24 12:41:01.715179 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 462/918] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:01 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:02.740133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9ccb49c9-b05a-41bf-aca1-794a2b24cc99 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:02.741201 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9ccb49c9-b05a-41bf-aca1-794a2b24cc99 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:02.800262 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9ccb49c9-b05a-41bf-aca1-794a2b24cc99 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:02.807723 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9ccb49c9-b05a-41bf-aca1-794a2b24cc99 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1213 microversion: 2.1 time: 0.075066 Aug 24 12:41:02.808248 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 457/919] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:02 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:03.831401 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:03.831985 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:03.839883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:03.840406 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:03.840920 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:03.841704 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:03.842193 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:03.842638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:04.068062 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:04.076049 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9e441fcc-51c9-4521-8c31-bdf62c6783da tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1217 microversion: 2.1 time: 0.250376 Aug 24 12:41:04.076622 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 463/920] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:03 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1217 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:05.097294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:05.098014 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:05.104841 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:05.105337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:05.105763 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:05.106486 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:05.106946 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:05.107367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:05.184762 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:05.193166 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-686f3767-0143-41fe-a0b9-fab60cab28ad tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1271 microversion: 2.1 time: 0.099828 Aug 24 12:41:05.194018 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 458/921] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:05 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:06.221102 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:06.221972 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:06.232396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.233269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.234002 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.235151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:06.235949 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:06.236883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:06.384259 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:06.392160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-551332e0-3829-4267-af59-81d50179947b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.177700 Aug 24 12:41:06.393371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 464/922] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:06 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:07.414863 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:07.415467 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:07.422556 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.423035 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.423462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.424178 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:07.424626 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:07.425072 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:07.561953 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:07.570045 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2eb927ba-d8e8-433e-ad7a-0a5a2afd6fbb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.159387 Aug 24 12:41:07.570620 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 459/923] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:07 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:08.308612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-4b62609a-2057-4069-89ee-950094581b13 req-16916968-3d38-41f1-9d84-09c8de66ddde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c01b39b-306c-4d13-ae17-632111825787", "tag": "fbf24b8c-5e14-45cf-b1a0-f86a7d2f6c92"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:08.318800 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4b62609a-2057-4069-89ee-950094581b13 req-16916968-3d38-41f1-9d84-09c8de66ddde service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.319272 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4b62609a-2057-4069-89ee-950094581b13 req-16916968-3d38-41f1-9d84-09c8de66ddde service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.319702 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-4b62609a-2057-4069-89ee-950094581b13 req-16916968-3d38-41f1-9d84-09c8de66ddde service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.330772 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-4b62609a-2057-4069-89ee-950094581b13 req-16916968-3d38-41f1-9d84-09c8de66ddde service nova] Creating event network-changed:fbf24b8c-5e14-45cf-b1a0-f86a7d2f6c92 for instance 1c01b39b-306c-4d13-ae17-632111825787 on hv-cinder-84605 Aug 24 12:41:08.336023 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-4b62609a-2057-4069-89ee-950094581b13 req-16916968-3d38-41f1-9d84-09c8de66ddde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031111 Aug 24 12:41:08.336599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 465/924] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:08.595457 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:08.596493 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:08.607283 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.608092 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.608847 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.610105 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:08.610923 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:08.611726 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:08.756943 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:08.764975 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4203be23-e2fd-4fa9-a4a1-adab38f0865f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.176473 Aug 24 12:41:08.765550 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 460/925] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:08 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:09.788618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:09.789386 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:09.796568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.797020 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.797541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.798281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:09.798773 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:09.799642 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:09.951836 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:09.960190 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-901bf799-3a06-4868-8747-58500d3d33c0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.176654 Aug 24 12:41:09.960801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 466/926] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:09 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:10.981261 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:10.982417 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:10.984986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:10.991421 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:10.991908 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:10.992340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:10.993095 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:10.993635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:10.994056 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:11.146688 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:11.155179 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fa971c56-255d-4fbf-8736-f39003cd6c75 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.178146 Aug 24 12:41:11.156706 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 461/927] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:10 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:12.179260 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:12.180018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:12.183038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=4 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:12.189829 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.190425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.191084 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.191923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:12.192489 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:12.193041 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:12.355763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:12.366328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-92addcff-e9f4-4a30-b611-3ed1c2b4e265 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.192318 Aug 24 12:41:12.366898 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 467/928] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:12 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:13.386873 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:13.387537 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:13.389983 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=10 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:13.396205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:13.396730 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:13.397178 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:13.397944 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:13.398482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:13.398925 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:13.540713 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:13.552108 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-63e15572-9488-41b2-88a4-571728841239 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.169202 Aug 24 12:41:13.552690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 462/929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:13 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:14.573414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:14.574053 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:14.581116 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.581601 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.582035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.582813 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:14.583260 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:14.583716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:14.728275 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:14.741632 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0ea6711f-9dbd-4885-9e90-94cd1e68408b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.171643 Aug 24 12:41:14.742419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 468/930] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:14 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:15.768060 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:15.768772 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:15.776464 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.776990 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.777430 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.778163 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:15.778624 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:15.779050 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:15.912699 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:15.922604 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-38967d4a-84a7-42f0-887d-c5193b2d0e74 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.159583 Aug 24 12:41:15.923191 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 463/931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:15 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:16.601741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:16.602745 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:16.613084 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.614083 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.615003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.615718 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.616165 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.616587 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.642815 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Going to try to terminate instance {{(pid=127299) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:41:16.727762 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e71813fa-119b-4dc5-aa76-a785e2dc812b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 204 len: 0 microversion: 2.1 time: 0.133619 Aug 24 12:41:16.729151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 469/932] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:41:16 2022] DELETE /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:41:16.736524 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:16.737269 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:16.743635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.744368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.744846 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.745557 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.746016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.746441 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.903175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:16.911567 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-aedacba0-9304-48b0-9881-4a4e8571a84f tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1577 microversion: 2.1 time: 0.178792 Aug 24 12:41:16.912637 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 464/933] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:16 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:16.936492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-46e234be-280a-4d29-b241-7d7d37a037df req-297a5230-9d6c-4eba-a776-3ada42b9aaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c01b39b-306c-4d13-ae17-632111825787", "name": "network-vif-plugged", "status": "completed", "tag": "fbf24b8c-5e14-45cf-b1a0-f86a7d2f6c92"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:16.946668 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:16.947672 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-46e234be-280a-4d29-b241-7d7d37a037df req-297a5230-9d6c-4eba-a776-3ada42b9aaa5 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.947896 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:16.948188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-46e234be-280a-4d29-b241-7d7d37a037df req-297a5230-9d6c-4eba-a776-3ada42b9aaa5 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.949564 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-46e234be-280a-4d29-b241-7d7d37a037df req-297a5230-9d6c-4eba-a776-3ada42b9aaa5 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.954593 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.955086 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.955524 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.956226 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:16.956774 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:16.957203 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:16.961396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-46e234be-280a-4d29-b241-7d7d37a037df req-297a5230-9d6c-4eba-a776-3ada42b9aaa5 service nova] Creating event network-vif-plugged:fbf24b8c-5e14-45cf-b1a0-f86a7d2f6c92 for instance 1c01b39b-306c-4d13-ae17-632111825787 on hv-cinder-84605 Aug 24 12:41:16.966372 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-46e234be-280a-4d29-b241-7d7d37a037df req-297a5230-9d6c-4eba-a776-3ada42b9aaa5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033893 Aug 24 12:41:16.966964 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 470/934] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:17.099414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:17.107757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4630dec8-782e-4210-a6bc-045570df688b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.166657 Aug 24 12:41:17.108334 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 465/935] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:16 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:41:17.937230 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:17.938066 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:17.946821 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.947322 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.947741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:17.948445 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:17.948938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:17.949396 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.094249 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:18.105879 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ef3c96fd-0ec3-481f-8227-dfcae76ae5f7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1577 microversion: 2.1 time: 0.175240 Aug 24 12:41:18.106654 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 471/936] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:17 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:18.129622 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:18.130189 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:18.137217 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:18.137628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:18.138071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.138756 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:18.139216 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:18.139629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:18.291649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:18.299777 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-97bda1a5-3b77-489b-bdd2-57255adb80bd tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.174434 Aug 24 12:41:18.300390 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 466/937] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:18 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:19.131116 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:19.131767 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:19.139382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.139924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.140406 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.141226 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.141735 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.142209 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.287408 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:19.295795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-199f0db3-cc29-4e51-bc36-d2dcc576c2c9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1577 microversion: 2.1 time: 0.170732 Aug 24 12:41:19.296362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 472/938] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:19 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:19.320775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:19.321390 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:19.328444 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.328967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.329402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.330096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:19.330551 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:19.330974 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:19.475295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:19.483490 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4be88dce-5f53-4c3b-8a45-6c8c774fbb84 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.167006 Aug 24 12:41:19.484083 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 467/939] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:19 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:20.320241 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:20.321464 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:20.328786 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.329358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.329832 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.330547 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.331168 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.331587 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.478277 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:20.486486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7e805402-e8da-427f-9991-e5e748c0543b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1577 microversion: 2.1 time: 0.170904 Aug 24 12:41:20.487113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 473/940] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:20 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:20.503333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:20.503993 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:20.510878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.511355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.511778 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.512460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:20.512941 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:20.513351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:20.650048 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:20.657784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d8996f88-eacd-4f69-a05b-5d8c40087c44 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1313 microversion: 2.1 time: 0.158391 Aug 24 12:41:20.658367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 468/941] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:20 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:21.509347 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:21.510607 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:21.518605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.519611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.520111 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.520904 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.521774 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.522196 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.681449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:21.682204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:21.688437 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.688977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.689412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.690350 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:21.690808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:21.691234 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:21.795916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:21.805123 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1a94a804-1d76-40dc-8989-adf08aa68982 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1577 microversion: 2.1 time: 0.300174 Aug 24 12:41:21.805975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 474/942] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:21 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1577 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:21.903846 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:21.912977 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3050886f-55f6-46a8-9745-fe9a242e26ee tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1497 microversion: 2.1 time: 0.236506 Aug 24 12:41:21.914279 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 469/943] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:21 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:22.346625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-a98c7574-1378-431c-8f62-e9ff8d4f14ed req-bce27888-bbdf-45c5-9631-f3d379617433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df", "name": "network-vif-deleted", "tag": "8372afc8-cc13-47d6-b4ca-043f1caa17ab"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:22.361674 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a98c7574-1378-431c-8f62-e9ff8d4f14ed req-bce27888-bbdf-45c5-9631-f3d379617433 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.362288 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a98c7574-1378-431c-8f62-e9ff8d4f14ed req-bce27888-bbdf-45c5-9631-f3d379617433 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.362914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-a98c7574-1378-431c-8f62-e9ff8d4f14ed req-bce27888-bbdf-45c5-9631-f3d379617433 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.383872 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-a98c7574-1378-431c-8f62-e9ff8d4f14ed req-bce27888-bbdf-45c5-9631-f3d379617433 service nova] Creating event network-vif-deleted:8372afc8-cc13-47d6-b4ca-043f1caa17ab for instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df on hv-cinder-84605 Aug 24 12:41:22.402667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-a98c7574-1378-431c-8f62-e9ff8d4f14ed req-bce27888-bbdf-45c5-9631-f3d379617433 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061876 Aug 24 12:41:22.404027 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 475/944] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:22.446388 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:22.446886 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:22.453343 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.453824 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.454255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.455147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.455570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.456049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.481381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:41:22.564185 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0584c7d3-0cb1-4f72-a4c7-58b3a48fd9ab tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 204 len: 0 microversion: 2.1 time: 0.121581 Aug 24 12:41:22.564774 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 470/945] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:41:22 2022] DELETE /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:41:22.573764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:22.574504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:22.581417 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.581903 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.582390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.583104 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.583552 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.583972 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.736444 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:22.749537 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f5fe7393-75b3-45a6-a1c6-d88a84ff2231 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1503 microversion: 2.1 time: 0.179863 Aug 24 12:41:22.750611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 476/946] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:22 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:22.829030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:22.831633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:22.841354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.841354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.841354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.841354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:22.844161 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:22.844602 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:22.914835 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:22.923309 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-185afb4b-671f-46fc-9882-b91a527491ae tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1225 microversion: 2.1 time: 0.099222 Aug 24 12:41:22.923965 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 471/947] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:22 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:23.774938 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:23.776006 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:23.782960 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.783446 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.783883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.784587 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.785174 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.785599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.941603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:23.945063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:23.946366 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:23.949512 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-1aebbc82-5dcb-4284-88c9-e112a73fcc11 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1503 microversion: 2.1 time: 0.179278 Aug 24 12:41:23.950252 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 477/948] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:23 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:23.953561 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.954280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.954801 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.955427 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:23.956070 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:23.956485 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:23.975570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:24.001684 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.002295 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.002729 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.003193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lazy-loading 'fault' on Instance uuid 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:41:24.050338 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:24.060710 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cec2854f-8d2c-4bc5-a236-2e3037e7b469 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 200 len: 1230 microversion: 2.1 time: 0.119814 Aug 24 12:41:24.061563 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 472/949] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:23 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:41:24.678297 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-6d09c70f-ece4-470d-9ecc-9497af49b92e req-db684366-b96c-4f13-8401-56aa6fdbd3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c01b39b-306c-4d13-ae17-632111825787", "name": "network-vif-deleted", "tag": "fbf24b8c-5e14-45cf-b1a0-f86a7d2f6c92"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:24.689406 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-6d09c70f-ece4-470d-9ecc-9497af49b92e req-db684366-b96c-4f13-8401-56aa6fdbd3b2 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.689828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-6d09c70f-ece4-470d-9ecc-9497af49b92e req-db684366-b96c-4f13-8401-56aa6fdbd3b2 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.690257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-6d09c70f-ece4-470d-9ecc-9497af49b92e req-db684366-b96c-4f13-8401-56aa6fdbd3b2 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.702266 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-6d09c70f-ece4-470d-9ecc-9497af49b92e req-db684366-b96c-4f13-8401-56aa6fdbd3b2 service nova] Creating event network-vif-deleted:fbf24b8c-5e14-45cf-b1a0-f86a7d2f6c92 for instance 1c01b39b-306c-4d13-ae17-632111825787 on hv-cinder-84605 Aug 24 12:41:24.707248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-6d09c70f-ece4-470d-9ecc-9497af49b92e req-db684366-b96c-4f13-8401-56aa6fdbd3b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033906 Aug 24 12:41:24.707852 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 478/950] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:24.974403 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:24.975158 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:24.988059 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.988803 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.989526 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:24.990165 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:24.990620 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:24.991051 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.026525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.027229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.027671 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.028120 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lazy-loading 'fault' on Instance uuid 1c01b39b-306c-4d13-ae17-632111825787 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:41:25.074098 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:25.083692 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:25.084492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:25.085012 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ee684436-1c11-4ae0-9eb4-a30e8d56b010 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 200 len: 1303 microversion: 2.1 time: 0.114556 Aug 24 12:41:25.085899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 473/951] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:24 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:25.092108 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.092603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.093098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.093791 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.094280 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.094694 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.115530 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] HTTP exception thrown: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Request method failure captured: Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df HTTP/1.1 Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhuwTf_D0-n0YPquzM4jixwvYrc-sMXo_Iw_s4siKEWI0XUrm6TYTWqLm-9FklgShytHOul0jeT2lpuATLVXJ4Ps5NTNPXA2eZw4WecCIwDREArwxOwlKDcgrVcSLETw7saygmbdUc8BJTNfYKEjIgNhgw2J8YeeTVRUgT8wj2jv4iQ Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:41:25.117263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e112083132a9492089fafdae9e34f4ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}] Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: ae1cd97c879141e2b4c1527b5964d054 Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:41:25.119000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df'} Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:41:25.119950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:41:25.122109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:25.123703 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Returning 404 to user: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:41:25.123703 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-52c6aa47-a50d-4374-b25a-1a19284e6d6e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 404 len: 111 microversion: 2.1 time: 0.040587 Aug 24 12:41:25.123703 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 479/952] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:25 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:41:25.259494 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-892013358", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1671158803", "security_groups": [{"name": "tempest-secgroup-smoke-1828489185"}], "block_device_mapping_v2": [{"uuid": "198749af-ab13-4fab-8fe6-d56ee9642818", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d723da1-b583-4f4b-bb15-ebfb46f0946c"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:25.403616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] validate_networks() for [('3d723da1-b583-4f4b-bb15-ebfb46f0946c', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:41:25.880750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:41:25.881417 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:41:25.882074 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:41:25.882664 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:41:25.883289 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:41:25.893735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.894216 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.895011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.896405 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:25.896405 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:25.896895 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:25.917471 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Getting quotas for project e112083132a9492089fafdae9e34f4ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:41:25.922940 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Getting quotas for user ae1cd97c879141e2b4c1527b5964d054 and project e112083132a9492089fafdae9e34f4ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:41:26.018017 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:41:26.020541 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='198749af-ab13-4fab-8fe6-d56ee9642818',volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:41:26.112099 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:26.112757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 1c01b39b-306c-4d13-ae17-632111825787] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:26.119833 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.120317 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.120856 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.121595 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.122175 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.122600 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.139368 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] HTTP exception thrown: Instance 1c01b39b-306c-4d13-ae17-632111825787 could not be found. Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Request method failure captured: Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 HTTP/1.1 Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhxZti1yb5iLCuCvd7PrEf5W4hNn6YMG60KSYgUiFroqRuLK0uK9_g5cctCbyRHhAzXVnJ9zZKpa8_wHps1IHacHZwY4Lq9m3DBsFaOINaoJaXyt68V7mI0bPR6oEkGTPsdKFPrz_09BLEesKAts_3e3Tqqj2XLZ_RhSHhTC8Weh_Hc Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 121d2511f42847cab3930da359a3a7ff Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-VolumesActionsTest-1354347227 Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:41:26.140944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/121d2511f42847cab3930da359a3a7ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_121d2511f42847cab3930da359a3a7ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/121d2511f42847cab3930da359a3a7ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/121d2511f42847cab3930da359a3a7ff"}]}] Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-VolumesActionsTest-1354347227 Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 121d2511f42847cab3930da359a3a7ff Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-VolumesActionsTest-1354347227 Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-VolumesActionsTest-1354347227-project Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 85620ae3c59a44da898ec76436271027 Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-VolumesActionsTest-1354347227-project Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 1c01b39b-306c-4d13-ae17-632111825787 could not be found. Aug 24 12:41:26.142360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '1c01b39b-306c-4d13-ae17-632111825787'} Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c01b39b-306c-4d13-ae17-632111825787 could not be found. Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:41:26.143157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c01b39b-306c-4d13-ae17-632111825787 could not be found. Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c01b39b-306c-4d13-ae17-632111825787 could not be found. Aug 24 12:41:26.144503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:26.145740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Returning 404 to user: Instance 1c01b39b-306c-4d13-ae17-632111825787 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:41:26.145740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-36f7c94c-63ba-45ac-bec3-c2309b6f29e4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787" status: 404 len: 111 microversion: 2.1 time: 0.034696 Aug 24 12:41:26.145740 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 480/953] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:26 2022] GET /compute/v2.1/servers/1c01b39b-306c-4d13-ae17-632111825787 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:41:26.180327 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3626683b-6199-439f-8dc1-8b0e0c7e8ffa tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.924566 Aug 24 12:41:26.181970 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 474/954] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:41:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:41:26.193005 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b1f41a72-868b-4675-be14-349aaf713661 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:26.193979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b1f41a72-868b-4675-be14-349aaf713661 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:26.263920 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b1f41a72-868b-4675-be14-349aaf713661 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:26.273025 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b1f41a72-868b-4675-be14-349aaf713661 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1094 microversion: 2.1 time: 0.084413 Aug 24 12:41:26.273182 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-201097907", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452", "networks": [{"uuid": "6c6d6000-ecbf-4c0c-8d0e-6f7676e46287"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:26.274161 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 481/955] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:26 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:26.341049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] validate_networks() for [('6c6d6000-ecbf-4c0c-8d0e-6f7676e46287', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:41:26.721577 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:41:26.722092 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:41:26.722750 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:41:26.723109 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:41:26.723512 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:41:26.732153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.732625 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.733116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.733795 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:26.734239 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:26.734651 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:26.752549 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Getting quotas for project 121d2511f42847cab3930da359a3a7ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:41:26.756513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Getting quotas for user 85620ae3c59a44da898ec76436271027 and project 121d2511f42847cab3930da359a3a7ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:41:26.767653 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:41:26.769857 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:41:26.797612 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:26.823766 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8743d4db-92d5-4f78-baa4-05bd412b89f4 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555573 Aug 24 12:41:26.824417 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 475/956] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:41:26.835730 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a0729049-912a-420b-a4c1-d245b0aea3e1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:26.835980 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a0729049-912a-420b-a4c1-d245b0aea3e1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:26.910731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a0729049-912a-420b-a4c1-d245b0aea3e1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:26.919360 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a0729049-912a-420b-a4c1-d245b0aea3e1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1213 microversion: 2.1 time: 0.087707 Aug 24 12:41:26.919966 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 482/957] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:26 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:27.295804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:27.297369 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:27.306216 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.306716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.307161 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.307883 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.308560 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.309040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.413482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:27.424601 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ad69e298-55ef-4e18-b17f-938f26edc9c8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1200 microversion: 2.1 time: 0.133682 Aug 24 12:41:27.425233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 476/958] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:27 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1200 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:27.943079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:27.943616 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:27.953088 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.953726 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.954288 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:27.955120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:27.955675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:27.956198 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.046864 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:28.051332 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:28.058359 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b4e1f240-343f-4432-b8e3-0badd6b131cb tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1273 microversion: 2.1 time: 0.120093 Aug 24 12:41:28.059055 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 483/959] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:27 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:28.451564 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:28.452107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:28.459262 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.459774 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.460207 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.460931 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:28.461373 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:28.461796 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:28.784101 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:28.793252 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b8727259-5e5c-4ed7-8acc-91d8c31944e4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1278 microversion: 2.1 time: 0.347835 Aug 24 12:41:28.793836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 477/960] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:28 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1278 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:29.094146 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:29.096321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:29.105353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.106194 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.106704 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.107503 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.108157 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.108788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.438884 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:29.450007 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-19cd5399-0eaa-49f4-ba80-d5d5b3f23129 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.361959 Aug 24 12:41:29.450855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 484/961] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:29 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:29.619973 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-b1773a9f-f00e-4c53-ad41-7eb2dd6a503b req-31f57872-a195-4acc-bf32-e4f0e3941992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aab27b4-3048-48ac-a85b-2bba4fdf2675", "tag": "fcfbb4d1-504e-43ae-aac3-8b6e8c84c917"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:29.632932 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b1773a9f-f00e-4c53-ad41-7eb2dd6a503b req-31f57872-a195-4acc-bf32-e4f0e3941992 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.633428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b1773a9f-f00e-4c53-ad41-7eb2dd6a503b req-31f57872-a195-4acc-bf32-e4f0e3941992 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.633868 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b1773a9f-f00e-4c53-ad41-7eb2dd6a503b req-31f57872-a195-4acc-bf32-e4f0e3941992 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.646333 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-b1773a9f-f00e-4c53-ad41-7eb2dd6a503b req-31f57872-a195-4acc-bf32-e4f0e3941992 service nova] Creating event network-changed:fcfbb4d1-504e-43ae-aac3-8b6e8c84c917 for instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 on hv-cinder-84605 Aug 24 12:41:29.651351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-b1773a9f-f00e-4c53-ad41-7eb2dd6a503b req-31f57872-a195-4acc-bf32-e4f0e3941992 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035074 Aug 24 12:41:29.651956 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 478/962] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:29.816376 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:29.816974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:29.818883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:29.824815 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.825284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.825716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:29.826417 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:29.826869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:29.827289 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.031064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:30.039467 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c3d15acc-ac63-41c3-b526-372670ea9f82 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.227972 Aug 24 12:41:30.040036 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 485/963] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:29 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:30.477153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:30.478058 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:30.488219 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:30.489153 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:30.489736 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.490771 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:30.491438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:30.492133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:30.639357 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:30.647585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6cf09e47-d31e-4772-809f-150316f65fa2 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.178209 Aug 24 12:41:30.648165 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 479/964] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:30 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:31.065611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:31.066623 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:31.077734 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.078546 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.079304 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.080403 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.081206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.081925 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.231208 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:31.240231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2da9b43f-2470-4973-a386-97a2ae887a5e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.180905 Aug 24 12:41:31.240800 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 486/965] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:31 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:31.668485 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:31.669209 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:31.669929 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-ead3d5ec-ce9c-4310-a017-9f74e86410f0 req-95d8061d-df16-47fd-9244-269e6507d735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86617272-246a-471e-804d-77255a3cd9a5", "tag": "fc5ad3b6-14a6-420e-90f7-6cb26b8fac4e"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:31.676662 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.676662 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.677125 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.677830 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.678315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.678731 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.683675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ead3d5ec-ce9c-4310-a017-9f74e86410f0 req-95d8061d-df16-47fd-9244-269e6507d735 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:31.684138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ead3d5ec-ce9c-4310-a017-9f74e86410f0 req-95d8061d-df16-47fd-9244-269e6507d735 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:31.684597 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ead3d5ec-ce9c-4310-a017-9f74e86410f0 req-95d8061d-df16-47fd-9244-269e6507d735 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:31.696615 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-ead3d5ec-ce9c-4310-a017-9f74e86410f0 req-95d8061d-df16-47fd-9244-269e6507d735 service nova] Creating event network-changed:fc5ad3b6-14a6-420e-90f7-6cb26b8fac4e for instance 86617272-246a-471e-804d-77255a3cd9a5 on hv-cinder-84605 Aug 24 12:41:31.704838 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-ead3d5ec-ce9c-4310-a017-9f74e86410f0 req-95d8061d-df16-47fd-9244-269e6507d735 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040465 Aug 24 12:41:31.710089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 480/966] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:31.814063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:31.827056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-81934538-44a2-4c1d-adf1-981d9417dd5c tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.162242 Aug 24 12:41:31.827823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 487/967] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:31 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:32.265381 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:32.266434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:32.275553 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.276015 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.276477 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.277218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.277673 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.278100 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.785690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:32.793992 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3e27eafc-428e-45f2-9019-808573c3f66b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.536184 Aug 24 12:41:32.794599 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 481/968] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:32 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:32.853380 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:32.854539 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:32.861184 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.861590 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.862250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:32.863113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:32.863570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:32.863986 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:33.182295 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:33.190364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2f3d327a-ac9e-4db5-8c2b-371379f0c955 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.340830 Aug 24 12:41:33.191047 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 488/969] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:32 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:33.819716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:33.820500 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:33.830323 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:33.830951 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:33.831463 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:33.832276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:33.832758 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:33.833190 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.130434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:34.140335 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5d9899ba-7e2d-4e45-8baa-6499421d3262 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.327604 Aug 24 12:41:34.141628 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 482/970] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:33 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:34.211611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:34.212478 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:34.221378 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:34.222098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:34.222684 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.223507 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:34.224064 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:34.224581 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:34.393976 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:34.402593 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0910d819-8e82-4fee-8b34-05ef87994b2f tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.194917 Aug 24 12:41:34.403167 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 489/971] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:34 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:35.165453 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:35.166355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:35.173103 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.173610 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.174068 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.174787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.175252 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.175680 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.381718 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:35.390238 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2c01f4c0-2932-4640-b1e4-432c3c6feb79 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.230481 Aug 24 12:41:35.390818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 483/972] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:35 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:35.425038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:35.426297 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:35.433273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.433764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.435638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.435638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:35.435638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:35.435963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:35.580479 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:35.588669 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c7c21699-bc47-4932-9df0-6c833dd74a25 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.167686 Aug 24 12:41:35.589335 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 490/973] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:35 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:36.412011 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:36.412979 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:36.420838 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.421187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.421702 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.422545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.423096 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.423599 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.584010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:36.594423 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a9bd5f16-c802-404e-8bf2-ecf7e9d1cdfd tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.186800 Aug 24 12:41:36.595008 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 484/974] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:36 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:36.611176 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:36.611870 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:36.619764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.620568 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.621371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.622371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:36.622999 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:36.623419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:36.756468 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:36.764709 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a529745e-ef40-4da9-86f2-9992eb9fc200 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.158571 Aug 24 12:41:36.765890 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 491/975] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:36 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:41:37.615749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:37.616365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:37.620272 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=4 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:37.620945 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=12 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:37.625551 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.626057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.626488 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.627207 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.627661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.628081 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.766867 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:37.774854 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f0f84ac0-b1c7-458a-84e6-9cd327e44890 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.163304 Aug 24 12:41:37.775438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 485/976] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:37 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:37.793839 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:37.794592 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:37.796521 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=4 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:37.802538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.803028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.803457 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.804188 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:37.804735 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:37.805496 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:37.939031 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:37.947108 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-b3e6e4be-afaa-4d92-a0e3-46fac90f0a36 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.157241 Aug 24 12:41:37.947682 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 492/977] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:37 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:38.622912 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-7e8e073d-42ab-4670-8026-a59e35122515 req-67ca039f-e781-448e-b4df-be975099f1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86617272-246a-471e-804d-77255a3cd9a5", "name": "network-vif-plugged", "status": "completed", "tag": "fc5ad3b6-14a6-420e-90f7-6cb26b8fac4e"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:38.633743 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-7e8e073d-42ab-4670-8026-a59e35122515 req-67ca039f-e781-448e-b4df-be975099f1e1 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.634436 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-7e8e073d-42ab-4670-8026-a59e35122515 req-67ca039f-e781-448e-b4df-be975099f1e1 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.635079 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-7e8e073d-42ab-4670-8026-a59e35122515 req-67ca039f-e781-448e-b4df-be975099f1e1 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.646791 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-7e8e073d-42ab-4670-8026-a59e35122515 req-67ca039f-e781-448e-b4df-be975099f1e1 service nova] Creating event network-vif-plugged:fc5ad3b6-14a6-420e-90f7-6cb26b8fac4e for instance 86617272-246a-471e-804d-77255a3cd9a5 on hv-cinder-84605 Aug 24 12:41:38.651555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-7e8e073d-42ab-4670-8026-a59e35122515 req-67ca039f-e781-448e-b4df-be975099f1e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035890 Aug 24 12:41:38.652497 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 486/978] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:38.796520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:38.797180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:38.804859 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.805858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.806386 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.807146 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.807611 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.808059 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.967496 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:38.967925 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:38.968619 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:38.975163 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.975652 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.976082 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.976819 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:38.977266 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:38.977687 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:38.982103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e743364b-bea0-4d97-a6ae-06bb4db1efbc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.189737 Aug 24 12:41:38.983305 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 493/979] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:38 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:39.124768 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:39.137276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4e871e1d-ffe2-4627-96b6-111df1b7da69 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.173192 Aug 24 12:41:39.138102 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 487/980] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:38 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:40.003823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:40.004524 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:40.011790 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.012518 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.012987 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.013712 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.014324 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.014739 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.162793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:40.163326 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:40.163462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:40.170156 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.171084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.171084 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.171782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:40.172327 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7a867e4c-b253-409e-a5f5-eac22c3c4f5b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.172463 Aug 24 12:41:40.172596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:40.173047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:40.173823 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 494/981] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:39 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:40.311396 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:40.320250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7f76684d-ec26-46ce-a598-8754264408d5 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.162846 Aug 24 12:41:40.321519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 488/982] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:40 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:41:41.194778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:41.195352 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:41.202414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.203000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.203429 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.204140 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.204597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.205122 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.342634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:41.343240 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:41.349853 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.350317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.350759 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.351455 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:41.351910 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:41.352329 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:41.359075 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:41.366917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5b184b7d-797f-4b84-a53a-e9db8846822b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.176238 Aug 24 12:41:41.367502 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 495/983] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:41 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:41.490505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:41.499408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b7a410fb-6942-4849-b1bb-44441a3cd4f0 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.160666 Aug 24 12:41:41.499986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 489/984] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:41 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:42.387622 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:42.388279 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:42.397032 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.397517 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.397947 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.398638 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.399079 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.399494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.519649 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:42.520294 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:42.527313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.527804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.528368 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.529119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:42.529580 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:42.530010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:42.533780 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:42.545849 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3319e50a-61da-4a51-a829-38191c5fce24 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.162052 Aug 24 12:41:42.546361 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 496/985] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:42 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:42.682995 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:42.695034 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1f7f7dec-4d84-4dba-a4f9-695a4e11e3b8 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1313 microversion: 2.1 time: 0.179051 Aug 24 12:41:42.695735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 490/986] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:42 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:43.572040 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:43.572826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:43.579170 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.579657 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.580095 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.580893 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.581273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.581747 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.718386 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:43.720375 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:43.721188 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:43.726809 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a0c40554-7c54-4524-a620-03cec81fc2ff tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.158930 Aug 24 12:41:43.727612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 497/987] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:43 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:41:43.727862 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.728351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.728884 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.729594 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:43.730047 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:43.730469 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:43.867828 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:43.871495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:43.876356 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c659f2c6-397c-4f8d-9ec9-821ead03c659 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1496 microversion: 2.1 time: 0.159777 Aug 24 12:41:43.876958 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 491/988] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:43 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:44.751785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:44.752869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:44.760447 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:44.760968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:44.761402 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:44.762092 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:44.762545 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:44.762961 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:44.893391 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:44.901289 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-81ae8b34-3322-4cd2-89cc-d995eead075e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.155911 Aug 24 12:41:44.901870 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 498/989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:44 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:45.925519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:45.926460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:45.933703 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:45.934190 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:45.934623 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:45.935314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:45.935769 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:45.936193 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:46.095661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:46.104997 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-69fef11d-9f66-4438-8a31-acf36b319857 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.185915 Aug 24 12:41:46.105562 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 492/990] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:45 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:46.804599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-9e2d1411-6158-43d2-a720-9a3f70aceee2 req-40e540bd-43a9-43ce-ba0b-3ad9ff3ab192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aab27b4-3048-48ac-a85b-2bba4fdf2675", "name": "network-vif-plugged", "status": "completed", "tag": "fcfbb4d1-504e-43ae-aac3-8b6e8c84c917"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:46.815364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9e2d1411-6158-43d2-a720-9a3f70aceee2 req-40e540bd-43a9-43ce-ba0b-3ad9ff3ab192 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:46.815765 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9e2d1411-6158-43d2-a720-9a3f70aceee2 req-40e540bd-43a9-43ce-ba0b-3ad9ff3ab192 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:46.816444 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9e2d1411-6158-43d2-a720-9a3f70aceee2 req-40e540bd-43a9-43ce-ba0b-3ad9ff3ab192 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:46.829327 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-9e2d1411-6158-43d2-a720-9a3f70aceee2 req-40e540bd-43a9-43ce-ba0b-3ad9ff3ab192 service nova] Creating event network-vif-plugged:fcfbb4d1-504e-43ae-aac3-8b6e8c84c917 for instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 on hv-cinder-84605 Aug 24 12:41:46.834657 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-9e2d1411-6158-43d2-a720-9a3f70aceee2 req-40e540bd-43a9-43ce-ba0b-3ad9ff3ab192 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034482 Aug 24 12:41:46.835488 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 499/991] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:47.022200 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:47.022848 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:47.029277 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.029825 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.030243 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.030949 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.031448 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.031883 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.058194 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:41:47.131380 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:47.132963 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:47.139833 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7c792610-6308-42e7-9cdc-a19fad695f60 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "DELETE /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 204 len: 0 microversion: 2.1 time: 0.121190 Aug 24 12:41:47.140488 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 493/992] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:41:47 2022] DELETE /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:41:47.149541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.150025 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:47.150881 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:47.151761 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.152975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.154048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.155336 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.156286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.157483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.157981 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.158435 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.159144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:47.159608 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:47.160355 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:47.361467 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:47.365225 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:47.371046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f779f84c-592a-4dbc-832c-f318cb4dac5b tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1502 microversion: 2.1 time: 0.225922 Aug 24 12:41:47.371634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 494/993] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:47 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:41:47.373019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-398cb9e2-8946-4866-a669-c03a4ff67fe5 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.249808 Aug 24 12:41:47.373623 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 500/994] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:47 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:41:48.392118 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:48.393030 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:48.394002 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:48.394637 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:48.400724 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.401244 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.401704 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.401829 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.402284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.402431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.402735 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.402933 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.403364 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.403473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:48.403903 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:48.404364 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:48.409052 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=100 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:41:48.609022 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:48.612291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:48.617215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f97d877d-8f76-40cd-8b4b-ff0ac2957ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.227249 Aug 24 12:41:48.618215 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 501/995] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:48 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:48.628517 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-196a06f6-05ef-46bd-a1fd-3844be8da3d1 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1502 microversion: 2.1 time: 0.240613 Aug 24 12:41:48.629411 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 495/996] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:48 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:49.641048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:49.641776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:49.651106 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.651788 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.652263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.653408 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.653724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.653857 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:49.654343 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.654436 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:49.662464 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.662952 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.663378 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.664089 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:49.664519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:49.664966 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:49.849148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:49.852683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:49.857375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-52685716-b4ba-40d5-9f1c-95aaf02c50d9 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.221314 Aug 24 12:41:49.858119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 502/997] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:49 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:49.862353 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0a422f65-7cc6-4eb0-a43e-0c6f3f157237 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1502 microversion: 2.1 time: 0.211958 Aug 24 12:41:49.868737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 496/998] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:49 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:50.881349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:50.881913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:50.886813 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:50.887465 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:50.888917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.889471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.889908 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.890607 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.891103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.891463 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.894246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.894764 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.895201 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:50.895937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:50.896437 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:50.896953 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:51.091816 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:51.101397 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:51.103906 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e731bfa5-fe14-48b9-a1ee-a245e3536c98 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.227956 Aug 24 12:41:51.104675 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 503/999] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:50 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:51.111511 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-12a0c8bd-d58a-4e41-abbb-7f1c5ef1151e tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1502 microversion: 2.1 time: 0.228540 Aug 24 12:41:51.112176 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 497/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:50 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:52.127673 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:52.129273 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:52.134281 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:52.135634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:52.138926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.139500 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.140008 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.140804 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.141430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.142042 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.142338 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.142821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.143256 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.143954 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.144408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.145072 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.700390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:52.709125 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-978f8f72-80ef-4835-a155-dbe79c8fce91 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1266 microversion: 2.1 time: 0.586323 Aug 24 12:41:52.710178 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 504/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:52 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1266 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:52.726145 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85620ae3c59a44da898ec76436271027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121d2511f42847cab3930da359a3a7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:52.734242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-340773e7-3a17-4f37-ab94-331f8c832d46 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 200 len: 1502 microversion: 2.1 time: 0.604342 Aug 24 12:41:52.734779 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 498/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:52 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 1502 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:52.917876 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-23b10bca-9165-4d8b-9b0d-2a9ca8657e04 req-09505bf2-d8cf-4dc1-8ea3-2e1906e1202a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86617272-246a-471e-804d-77255a3cd9a5", "name": "network-vif-deleted", "tag": "fc5ad3b6-14a6-420e-90f7-6cb26b8fac4e"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:52.928911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-23b10bca-9165-4d8b-9b0d-2a9ca8657e04 req-09505bf2-d8cf-4dc1-8ea3-2e1906e1202a service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:52.929392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-23b10bca-9165-4d8b-9b0d-2a9ca8657e04 req-09505bf2-d8cf-4dc1-8ea3-2e1906e1202a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:52.929821 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-23b10bca-9165-4d8b-9b0d-2a9ca8657e04 req-09505bf2-d8cf-4dc1-8ea3-2e1906e1202a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:52.940881 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-23b10bca-9165-4d8b-9b0d-2a9ca8657e04 req-09505bf2-d8cf-4dc1-8ea3-2e1906e1202a service nova] Creating event network-vif-deleted:fc5ad3b6-14a6-420e-90f7-6cb26b8fac4e for instance 86617272-246a-471e-804d-77255a3cd9a5 on hv-cinder-84605 Aug 24 12:41:52.946789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-23b10bca-9165-4d8b-9b0d-2a9ca8657e04 req-09505bf2-d8cf-4dc1-8ea3-2e1906e1202a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Aug 24 12:41:52.947389 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 505/1003] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:41:53.730644 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:53.732003 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:53.744245 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.745287 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.745997 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.754669 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.755660 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.756236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.758582 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:53.759979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] [instance: 86617272-246a-471e-804d-77255a3cd9a5] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:53.770724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.771492 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.772028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.773139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.773678 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.774443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.794673 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] HTTP exception thrown: Instance 86617272-246a-471e-804d-77255a3cd9a5 could not be found. Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Request method failure captured: Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 HTTP/1.1 Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhxZti1yb5iLCuCvd7PrEf5W4hNn6YMG60KSYgUiFroqRuLK0uK9_g5cctCbyRHhAzXVnJ9zZKpa8_wHps1IHacHZwY4Lq9m3DBsFaOINaoJaXyt68V7mI0bPR6oEkGTPsdKFPrz_09BLEesKAts_3e3Tqqj2XLZ_RhSHhTC8Weh_Hc Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 121d2511f42847cab3930da359a3a7ff Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-VolumesActionsTest-1354347227 Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:41:53.796527 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/121d2511f42847cab3930da359a3a7ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_121d2511f42847cab3930da359a3a7ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/121d2511f42847cab3930da359a3a7ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/121d2511f42847cab3930da359a3a7ff"}]}] Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-VolumesActionsTest-1354347227 Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 121d2511f42847cab3930da359a3a7ff Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-VolumesActionsTest-1354347227 Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-VolumesActionsTest-1354347227-project Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 85620ae3c59a44da898ec76436271027 Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-VolumesActionsTest-1354347227-project Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 86617272-246a-471e-804d-77255a3cd9a5 could not be found. Aug 24 12:41:53.798139 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '86617272-246a-471e-804d-77255a3cd9a5'} Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86617272-246a-471e-804d-77255a3cd9a5 could not be found. Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:41:53.799038 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86617272-246a-471e-804d-77255a3cd9a5 could not be found. Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86617272-246a-471e-804d-77255a3cd9a5 could not be found. Aug 24 12:41:53.800462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:41:53.803510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] Returning 404 to user: Instance 86617272-246a-471e-804d-77255a3cd9a5 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:41:53.804414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-84b86656-fb71-40fe-960d-e08df1609049 tempest-VolumesActionsTest-1354347227 tempest-VolumesActionsTest-1354347227-project] 10.222.0.27 "GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5" status: 404 len: 111 microversion: 2.1 time: 0.052444 Aug 24 12:41:53.805015 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 506/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:53 2022] GET /compute/v2.1/servers/86617272-246a-471e-804d-77255a3cd9a5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:41:53.929687 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:53.938209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-04442893-63cd-4ac1-9fab-86414f777e95 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1452 microversion: 2.1 time: 0.211456 Aug 24 12:41:53.938887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 499/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:53 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:53.958689 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:41:53.959309 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:41:53.965986 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.966625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.967068 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:53.967765 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:53.968218 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:53.968782 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:54.109395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:41:54.117733 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-75cfc764-7822-46f0-a2af-f513aef362ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1452 microversion: 2.1 time: 0.163079 Aug 24 12:41:54.118313 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 507/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:41:53 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:41:55.933650 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-44e69c17-b17d-4150-be39-59aca6a87f20 req-307f0045-c605-4a40-92cc-a3aa395029a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aab27b4-3048-48ac-a85b-2bba4fdf2675", "tag": "fcfbb4d1-504e-43ae-aac3-8b6e8c84c917"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:41:55.943876 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-44e69c17-b17d-4150-be39-59aca6a87f20 req-307f0045-c605-4a40-92cc-a3aa395029a7 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:41:55.944346 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-44e69c17-b17d-4150-be39-59aca6a87f20 req-307f0045-c605-4a40-92cc-a3aa395029a7 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:41:55.944817 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-44e69c17-b17d-4150-be39-59aca6a87f20 req-307f0045-c605-4a40-92cc-a3aa395029a7 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:41:55.955890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-44e69c17-b17d-4150-be39-59aca6a87f20 req-307f0045-c605-4a40-92cc-a3aa395029a7 service nova] Creating event network-changed:fcfbb4d1-504e-43ae-aac3-8b6e8c84c917 for instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 on hv-cinder-84605 Aug 24 12:41:55.961301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-44e69c17-b17d-4150-be39-59aca6a87f20 req-307f0045-c605-4a40-92cc-a3aa395029a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031311 Aug 24 12:41:55.961869 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 500/1007] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:41.663422 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-91976535", "imageRef": "702bc34e-62b3-4d9f-8401-d0b2f904b87a", "flavorRef": "452"}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:41.670570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=45 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:41.671244 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=32 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:41.916160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] validate_networks() for None {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:42:42.202071 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:42:42.202486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:42:42.202948 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:42:42.203388 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:42:42.203787 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:42:42.213577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.214062 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.214489 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.215217 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:42.215645 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:42.216063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:42.234544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Getting quotas for project c5da2f4e102b49438b2b80ba75d1bf0c. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:42:42.238656 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Getting quotas for user 7159c045925f48e8a03594a7d38e9d27 and project c5da2f4e102b49438b2b80ba75d1bf0c. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:42:42.251076 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:42:42.253878 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='702bc34e-62b3-4d9f-8401-d0b2f904b87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:42:42.303099 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3fdb175f-9c08-4a86-b7ee-140115776031 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643501 Aug 24 12:42:42.310061 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 508/1008] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:42:42.316083 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-617db4ad-dd8f-4568-b92c-00f2596f7d5f tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:42.316829 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-617db4ad-dd8f-4568-b92c-00f2596f7d5f tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:42.322402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:42.323057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:42.557914 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-617db4ad-dd8f-4568-b92c-00f2596f7d5f tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:42.566611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-617db4ad-dd8f-4568-b92c-00f2596f7d5f tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1213 microversion: 2.1 time: 0.255128 Aug 24 12:42:42.567194 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 501/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:42 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1213 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:43.589946 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:43.590723 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:43.598637 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:43.599237 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:43.599899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:43.601320 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:43.602024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:43.602583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:43.741554 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:43.755862 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-307d1fb1-3d47-42b7-9074-987bb54f762b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1283 microversion: 2.1 time: 0.172292 Aug 24 12:42:43.756919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 509/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:43 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1283 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:44.779695 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:44.780505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:44.788417 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.789394 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.790063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:44.790973 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:44.791634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:44.792057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.112392 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:45.124386 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-aa03faff-be30-4d54-a44f-2d3d03aea3ec tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1313 microversion: 2.1 time: 0.348968 Aug 24 12:42:45.128694 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 502/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:44 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:45.442737 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-d724e6a7-0d02-4a48-a48d-10ade75497cc req-9f14d97b-4770-4b31-b02e-a3d284bc00da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0", "tag": "56ed0be3-8d2e-408d-9258-93beee349365"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:45.455776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-d724e6a7-0d02-4a48-a48d-10ade75497cc req-9f14d97b-4770-4b31-b02e-a3d284bc00da service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:45.456358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-d724e6a7-0d02-4a48-a48d-10ade75497cc req-9f14d97b-4770-4b31-b02e-a3d284bc00da service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:45.457028 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-d724e6a7-0d02-4a48-a48d-10ade75497cc req-9f14d97b-4770-4b31-b02e-a3d284bc00da service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:45.477386 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-d724e6a7-0d02-4a48-a48d-10ade75497cc req-9f14d97b-4770-4b31-b02e-a3d284bc00da service nova] Creating event network-changed:56ed0be3-8d2e-408d-9258-93beee349365 for instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 on hv-cinder-84605 Aug 24 12:42:45.485344 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-d724e6a7-0d02-4a48-a48d-10ade75497cc req-9f14d97b-4770-4b31-b02e-a3d284bc00da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046132 Aug 24 12:42:45.486857 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 510/1012] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:42:46.146948 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:46.148452 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:46.156890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.157869 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.158545 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.160595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:46.163373 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:46.164107 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:46.453753 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:46.464887 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-64bc65fd-b568-46af-bc1f-fafcf303ab39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1313 microversion: 2.1 time: 0.322242 Aug 24 12:42:46.480508 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 503/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:46 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:47.487469 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:47.489871 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:47.502086 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:47.502591 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:47.503026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:47.503779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:47.504241 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:47.504685 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:47.763409 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:47.775538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0afee324-2755-473a-bccd-fdea1fc0d536 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1313 microversion: 2.1 time: 0.289295 Aug 24 12:42:47.775538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 511/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:47 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:48.793428 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:48.794818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:48.801148 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.801850 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.802474 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.803210 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:48.803664 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:48.804082 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:48.924349 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:42:48.924746 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Wed Aug 24 12:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 (ip 10.222.0.27) !!! Aug 24 12:42:49.002941 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:49.012674 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3cafc665-f055-469b-b81e-6bd205472138 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1313 microversion: 2.1 time: 0.223025 Aug 24 12:42:49.013747 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 504/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:48 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:50.035576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:50.037381 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:50.044844 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:50.045576 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:50.046151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:50.047191 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:50.047787 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:50.048367 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:50.195291 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:50.203566 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3608baf6-183f-4b87-9875-9d854e13fc39 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1313 microversion: 2.1 time: 0.172788 Aug 24 12:42:50.204233 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 512/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:50 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:51.225339 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:51.226576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:51.233402 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.234147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.234742 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.235666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.236276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.236881 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.467643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:51.487422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3d9cf731-5bef-420b-8305-eba29e77de41 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1313 microversion: 2.1 time: 0.256006 Aug 24 12:42:51.489033 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 505/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:51 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:51.927778 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-389b6de4-b49a-4663-8749-4c925b57ee26 req-f4aa913b-d261-4217-8be6-a64971f28f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0", "name": "network-vif-plugged", "status": "completed", "tag": "56ed0be3-8d2e-408d-9258-93beee349365"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:51.945425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-389b6de4-b49a-4663-8749-4c925b57ee26 req-f4aa913b-d261-4217-8be6-a64971f28f7b service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:51.946191 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-389b6de4-b49a-4663-8749-4c925b57ee26 req-f4aa913b-d261-4217-8be6-a64971f28f7b service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:51.946789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-389b6de4-b49a-4663-8749-4c925b57ee26 req-f4aa913b-d261-4217-8be6-a64971f28f7b service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:51.967072 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-389b6de4-b49a-4663-8749-4c925b57ee26 req-f4aa913b-d261-4217-8be6-a64971f28f7b service nova] Creating event network-vif-plugged:56ed0be3-8d2e-408d-9258-93beee349365 for instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 on hv-cinder-84605 Aug 24 12:42:51.974705 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-389b6de4-b49a-4663-8749-4c925b57ee26 req-f4aa913b-d261-4217-8be6-a64971f28f7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050351 Aug 24 12:42:51.976008 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 513/1018] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:52.509634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:52.510445 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:52.522138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.524983 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.525662 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.526579 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:52.527192 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:52.527758 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:52.565844 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:52.894998 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:52.937884 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0638fce3-c9f7-4d7d-8895-472b8732fd12 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1313 microversion: 2.1 time: 0.432836 Aug 24 12:42:52.950716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 506/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:52 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:53.380934 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:53.381785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=6 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:42:53.604620 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9471fae1-4a44-4b44-9428-bf60572c921b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Action: 'create', calling method: .version_select at 0x7fa676da6ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1974212249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICqvtBL+BV3qJ9NlDWP1MCJlqkpmRz+qeJW2i6tBML9x8DdBaOOoa3boqfP/IVKp99qQ7clR7d4fxwqdlr9fWCWslUjGzsiEvUFuMTPXqAxGjT4LCkl7HLv3f6PZ7kvIQ=="}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:53.623818 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-9471fae1-4a44-4b44-9428-bf60572c921b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Getting quotas for project 176f865ce7f542f4a7af595b17e2324a. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:42:53.628248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-9471fae1-4a44-4b44-9428-bf60572c921b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Getting quotas for user 057e6fd8802348b988baaa181ee163da and project 176f865ce7f542f4a7af595b17e2324a. Resources: {'key_pairs'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:42:53.653859 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9471fae1-4a44-4b44-9428-bf60572c921b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.277911 Aug 24 12:42:53.654463 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 514/1020] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 12:42:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:53.958495 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:53.959246 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:53.967414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.967908 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.968347 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:53.969125 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:53.969579 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:53.970002 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.166315 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:54.174721 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e223f36d-54ef-4ad0-bd2e-85ba55d1185b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1463 microversion: 2.1 time: 0.220137 Aug 24 12:42:54.175328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 507/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:53 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1463 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:54.220793 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:54.221412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:54.228459 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.228982 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.229414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.230105 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.230555 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.230971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.256060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Going to try to terminate instance {{(pid=127299) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:42:54.345478 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-508f6e0b-ca6e-4c7c-b8d6-de2bcdc1232d tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 204 len: 0 microversion: 2.1 time: 0.128135 Aug 24 12:42:54.346257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 515/1022] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:42:54 2022] DELETE /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:42:54.355260 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:54.356250 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:54.363099 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.363728 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.364525 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.365361 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:54.365888 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:54.366497 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:54.513236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:54.521361 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fe669dbf-087e-476e-97ae-a89f3f79213a tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1469 microversion: 2.1 time: 0.170509 Aug 24 12:42:54.521940 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 508/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:54 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:55.543543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:55.544902 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:55.551486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.551994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.552400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.553120 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:55.553577 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:55.554140 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:55.699325 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:55.708134 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d6240290-70ae-4046-b62e-2de51f8e4cd0 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1469 microversion: 2.1 time: 0.169744 Aug 24 12:42:55.708914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 516/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:55 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:42:56.731446 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:56.732168 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:56.750920 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.751420 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.752247 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.753346 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.753803 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.754589 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:56.888388 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7159c045925f48e8a03594a7d38e9d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5da2f4e102b49438b2b80ba75d1bf0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:42:56.897714 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d0403f86-a812-4d28-b790-94093b342b2b tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 200 len: 1427 microversion: 2.1 time: 0.170144 Aug 24 12:42:56.899228 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 509/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:56 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:42:56.933605 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-9cf550ca-9355-40af-af4e-8f5884e11769 req-776e2762-194a-4d65-8067-2510519df416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0", "name": "network-vif-deleted", "tag": "56ed0be3-8d2e-408d-9258-93beee349365"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:42:56.982286 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9cf550ca-9355-40af-af4e-8f5884e11769 req-776e2762-194a-4d65-8067-2510519df416 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:56.982749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9cf550ca-9355-40af-af4e-8f5884e11769 req-776e2762-194a-4d65-8067-2510519df416 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:56.983216 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-9cf550ca-9355-40af-af4e-8f5884e11769 req-776e2762-194a-4d65-8067-2510519df416 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.001328 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-9cf550ca-9355-40af-af4e-8f5884e11769 req-776e2762-194a-4d65-8067-2510519df416 service nova] Creating event network-vif-deleted:56ed0be3-8d2e-408d-9258-93beee349365 for instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 on hv-cinder-84605 Aug 24 12:42:57.013412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-9cf550ca-9355-40af-af4e-8f5884e11769 req-776e2762-194a-4d65-8067-2510519df416 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084198 Aug 24 12:42:57.014769 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 517/1026] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:42:57.921517 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:42:57.922187 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] [instance: 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:42:57.931457 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.931950 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.932383 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.933151 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:42:57.933603 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:42:57.934074 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:42:57.951345 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] HTTP exception thrown: Instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 could not be found. Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Request method failure captured: Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 HTTP/1.1 Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhy_EKrPik98-5FTsOTCVWzCt13dSsiGL9oiC4CuaO86EXL8sGol48hAn9uVUCjEgIazFLPihFZ_rpk85YCkEFpJv6hQlXeLT4ycFaYts3leeQnj6GxC-hfg7NKt-SXaOveFyVQ_cJuYe1y6caGyiSOYFXLN2VplkiO9dbX4MJMLVQc Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: c5da2f4e102b49438b2b80ba75d1bf0c Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesNegativeTest-588444751 Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:42:57.953144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c5da2f4e102b49438b2b80ba75d1bf0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c5da2f4e102b49438b2b80ba75d1bf0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5da2f4e102b49438b2b80ba75d1bf0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5da2f4e102b49438b2b80ba75d1bf0c"}]}] Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesNegativeTest-588444751 Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: c5da2f4e102b49438b2b80ba75d1bf0c Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesNegativeTest-588444751 Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesNegativeTest-588444751-project Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: 7159c045925f48e8a03594a7d38e9d27 Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesNegativeTest-588444751-project Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 could not be found. Aug 24 12:42:57.954633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0'} Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 could not be found. Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:42:57.955570 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 could not be found. Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 could not be found. Aug 24 12:42:57.957075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:42:57.958309 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] Returning 404 to user: Instance 2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:42:57.958309 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8fddbb75-470a-44a0-9549-c98b7141d513 tempest-VolumesNegativeTest-588444751 tempest-VolumesNegativeTest-588444751-project] 10.222.0.27 "GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0" status: 404 len: 111 microversion: 2.1 time: 0.038493 Aug 24 12:42:57.958309 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 510/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:42:57 2022] GET /compute/v2.1/servers/2be1c8ce-54c7-4449-b9c1-8e4d9fe956d0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:43:14.349710 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=4 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:14.350541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:14.351255 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:14.356228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-585677158", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1974212249", "security_groups": [{"name": "tempest-secgroup-smoke-1235859947"}], "networks": [{"uuid": "d8602067-c233-4c98-b1df-3ec6d04e9730"}], "block_device_mapping_v2": [{"uuid": "ac04c0e8-2a7a-4b00-a4a7-7b570e05d573", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:14.475554 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] validate_networks() for [('d8602067-c233-4c98-b1df-3ec6d04e9730', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:43:14.879302 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:43:14.879982 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:43:14.880797 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:43:14.881232 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:43:14.881901 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:43:14.892695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:14.893180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:14.893606 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:14.894332 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:14.894783 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:14.895198 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:14.913399 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Getting quotas for project 176f865ce7f542f4a7af595b17e2324a. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:43:14.918248 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Getting quotas for user 057e6fd8802348b988baaa181ee163da and project 176f865ce7f542f4a7af595b17e2324a. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:43:14.977899 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:43:14.980386 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac04c0e8-2a7a-4b00-a4a7-7b570e05d573',volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:43:15.125414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d7522536-155f-4c08-9697-ddc4f65c413b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.777215 Aug 24 12:43:15.126130 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 518/1028] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:43:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:43:15.137379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-806371c7-8549-4265-b074-bad7e234001e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:15.137990 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-806371c7-8549-4265-b074-bad7e234001e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:15.140046 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=22 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:15.140707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=50 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:15.194634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-806371c7-8549-4265-b074-bad7e234001e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:15.202700 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-806371c7-8549-4265-b074-bad7e234001e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1088 microversion: 2.1 time: 0.069404 Aug 24 12:43:15.203287 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 511/1029] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:15 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:16.227365 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:16.228495 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:16.238267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:16.238763 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:16.239205 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:16.239913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:16.240377 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:16.240832 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:16.335103 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:16.344926 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ca4cbd01-091c-4b1d-8942-eaad6e801bb6 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1194 microversion: 2.1 time: 0.124898 Aug 24 12:43:16.345542 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 519/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:16 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:17.368930 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:17.369629 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:17.376362 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:17.377072 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:17.377527 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:17.378214 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:17.378634 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:17.379055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:17.634384 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:17.643205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c2c209e4-8212-490d-a25e-cd8be9ce19e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.280376 Aug 24 12:43:17.643807 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 512/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:17 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:17.985885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-c61a9d4f-cbb7-4da3-8f8a-dc93a77a1ba8 req-e97efd6e-a4e0-449a-926f-df3c1cdf8476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b850f9b1-6213-4060-965e-203ae165fe96", "tag": "dd9b8d4c-fd29-42e9-9724-26157f9ef99e"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:18.001144 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-c61a9d4f-cbb7-4da3-8f8a-dc93a77a1ba8 req-e97efd6e-a4e0-449a-926f-df3c1cdf8476 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:18.001658 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-c61a9d4f-cbb7-4da3-8f8a-dc93a77a1ba8 req-e97efd6e-a4e0-449a-926f-df3c1cdf8476 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:18.002094 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-c61a9d4f-cbb7-4da3-8f8a-dc93a77a1ba8 req-e97efd6e-a4e0-449a-926f-df3c1cdf8476 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:18.013350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-c61a9d4f-cbb7-4da3-8f8a-dc93a77a1ba8 req-e97efd6e-a4e0-449a-926f-df3c1cdf8476 service nova] Creating event network-changed:dd9b8d4c-fd29-42e9-9724-26157f9ef99e for instance b850f9b1-6213-4060-965e-203ae165fe96 on hv-cinder-84605 Aug 24 12:43:18.018300 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-c61a9d4f-cbb7-4da3-8f8a-dc93a77a1ba8 req-e97efd6e-a4e0-449a-926f-df3c1cdf8476 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037471 Aug 24 12:43:18.019073 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 520/1032] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:18.668414 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:18.669088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:18.675661 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:18.676164 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:18.676575 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:18.677297 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:18.677747 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:18.678159 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:18.832016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:18.840555 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-18aaccc8-acda-43f4-9016-1cabbd5e4aae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.177362 Aug 24 12:43:18.841147 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 513/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:18 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:19.864782 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:19.865614 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:19.872504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:19.873010 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:19.873438 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:19.874115 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:19.874562 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:19.874974 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:20.024543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:20.032971 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bc192515-6543-4aa9-968e-78e60d28c721 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.173249 Aug 24 12:43:20.033539 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 521/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:19 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:43:21.054133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:21.054696 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:21.061667 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:21.062150 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:21.062576 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:21.063264 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:21.063710 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:21.064127 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:21.200812 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:21.209230 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-52c86ab5-fa65-4a41-889a-5adbd0b012e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.159076 Aug 24 12:43:21.209806 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 514/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:21 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:22.231845 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:22.232512 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:22.239824 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:22.240242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:22.240684 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:22.241382 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:22.241826 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:22.242242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:22.382789 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:22.391643 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-12d6b272-c5dc-4f68-8f03-362b7a8342c2 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.164337 Aug 24 12:43:22.392201 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 522/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:22 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:23.424072 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:23.425119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:23.434804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:23.435305 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:23.435740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:23.437091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:23.437554 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:23.437979 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:23.574621 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:23.586896 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2bbf6004-2a0e-4f52-addd-4b31210873c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.169214 Aug 24 12:43:23.587821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 515/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:23 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:24.612500 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:24.613491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:24.625121 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:24.625917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:24.626672 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:24.627867 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:24.628613 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:24.629490 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:24.767612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:24.779486 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ad796413-7462-4be5-be96-a51be02b9d8a tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.173568 Aug 24 12:43:24.780391 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 523/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:24 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:25.804479 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:25.805054 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:25.808460 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:25.814268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:25.814749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:25.815154 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:25.815865 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:25.816314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:25.816741 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:25.965727 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:25.974462 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9d52ccbf-4bc4-4c2e-be2e-ede17c529733 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.176483 Aug 24 12:43:25.975042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 516/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:25 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:26.996148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:26.997251 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:26.999254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:26.999919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=6 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:27.006550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:27.007035 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:27.007471 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:27.008162 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:27.008610 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:27.009057 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:27.160619 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:27.171920 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-7218226d-6d4e-4166-ada8-85831fbca924 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.180043 Aug 24 12:43:27.172590 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 524/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:26 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:28.196110 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:28.196818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:28.203883 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:28.204404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:28.205050 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:28.205754 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:28.206206 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:28.206646 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:28.348081 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:28.356274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b95c6fd5-672b-4c3b-8070-a79b40c0b77b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.163998 Aug 24 12:43:28.357306 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 517/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:28 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:29.379569 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:29.380296 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:29.388954 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:29.389559 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:29.390096 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:29.390956 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:29.391524 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:29.392056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:29.539980 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:29.548566 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f9a5170a-bbbe-4d0f-b6cb-b527bf2738e9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.173937 Aug 24 12:43:29.549250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 525/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:29 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:30.569784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:30.570386 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:30.577279 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:30.577817 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:30.578237 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:30.578939 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:30.579392 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:30.579822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:30.722152 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:30.730829 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9b63541d-5e86-4ad5-b0d9-4b326885b17f tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.165135 Aug 24 12:43:30.731412 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 518/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:30 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:31.758395 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:31.759000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:31.766806 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.767289 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.767714 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.768404 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.768890 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.769309 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.913063 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:31.921662 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-2b957019-be19-4622-8a92-82e03a8b6ed7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.167265 Aug 24 12:43:31.922025 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 526/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:31 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:31.970253 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-22f340b9-226e-48ce-9cb4-969737f51988 req-f9225c57-e317-4924-b1b7-9d93fcbea8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b850f9b1-6213-4060-965e-203ae165fe96", "name": "network-vif-plugged", "status": "completed", "tag": "dd9b8d4c-fd29-42e9-9724-26157f9ef99e"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:31.981280 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-22f340b9-226e-48ce-9cb4-969737f51988 req-f9225c57-e317-4924-b1b7-9d93fcbea8de service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:31.981877 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-22f340b9-226e-48ce-9cb4-969737f51988 req-f9225c57-e317-4924-b1b7-9d93fcbea8de service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:31.982505 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-22f340b9-226e-48ce-9cb4-969737f51988 req-f9225c57-e317-4924-b1b7-9d93fcbea8de service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:31.996234 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-22f340b9-226e-48ce-9cb4-969737f51988 req-f9225c57-e317-4924-b1b7-9d93fcbea8de service nova] Creating event network-vif-plugged:dd9b8d4c-fd29-42e9-9724-26157f9ef99e for instance b850f9b1-6213-4060-965e-203ae165fe96 on hv-cinder-84605 Aug 24 12:43:32.002543 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-22f340b9-226e-48ce-9cb4-969737f51988 req-f9225c57-e317-4924-b1b7-9d93fcbea8de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036054 Aug 24 12:43:32.003143 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 519/1045] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:32.942534 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:32.943118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:32.950148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:32.950659 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:32.951073 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:32.951801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:32.952301 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:32.952779 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:33.105635 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:33.113487 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e30bc725-fd79-4507-b282-4b1ee71a1557 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1260 microversion: 2.1 time: 0.174997 Aug 24 12:43:33.114050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 527/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:32 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:34.135110 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:34.135859 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:34.143358 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.143845 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.144285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.145020 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.145482 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.145909 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.287091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:34.299314 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4964f7da-9bef-421e-9682-1ed07dd10a12 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1444 microversion: 2.1 time: 0.168235 Aug 24 12:43:34.300163 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 520/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:34 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:34.323036 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:34.323987 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:34.334340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.335091 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.335583 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.336624 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:34.337371 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:34.338118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:34.479889 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:34.493854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a040facc-2e4d-4cdb-a4c9-952538ef9c5c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1444 microversion: 2.1 time: 0.177163 Aug 24 12:43:34.494968 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 528/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:34 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1444 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:36.326390 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-816612177", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1671158803", "security_groups": [{"name": "tempest-secgroup-smoke-1828489185"}], "block_device_mapping_v2": [{"uuid": "43bf92c1-ddd9-4dc4-8956-c63483308b31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d723da1-b583-4f4b-bb15-ebfb46f0946c"}]}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:36.392214 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-90a278e5-f286-4f3e-aa0b-190467bd4a7b req-a4779277-7731-41c6-a4e2-0d6f8e81ee90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b850f9b1-6213-4060-965e-203ae165fe96", "tag": "dd9b8d4c-fd29-42e9-9724-26157f9ef99e"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:36.401818 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-90a278e5-f286-4f3e-aa0b-190467bd4a7b req-a4779277-7731-41c6-a4e2-0d6f8e81ee90 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:36.402296 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-90a278e5-f286-4f3e-aa0b-190467bd4a7b req-a4779277-7731-41c6-a4e2-0d6f8e81ee90 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:36.402727 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-90a278e5-f286-4f3e-aa0b-190467bd4a7b req-a4779277-7731-41c6-a4e2-0d6f8e81ee90 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:36.416086 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-90a278e5-f286-4f3e-aa0b-190467bd4a7b req-a4779277-7731-41c6-a4e2-0d6f8e81ee90 service nova] Creating event network-changed:dd9b8d4c-fd29-42e9-9724-26157f9ef99e for instance b850f9b1-6213-4060-965e-203ae165fe96 on hv-cinder-84605 Aug 24 12:43:36.423057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-90a278e5-f286-4f3e-aa0b-190467bd4a7b req-a4779277-7731-41c6-a4e2-0d6f8e81ee90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168144 Aug 24 12:43:36.423663 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 521/1049] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:36.460855 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.network.neutron [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] validate_networks() for [('3d723da1-b583-4f4b-bb15-ebfb46f0946c', None, None, None, None, None)] {{(pid=127299) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 12:43:37.502116 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Flavor limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 12:43:37.502705 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Image limits 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 12:43:37.503373 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Flavor pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 12:43:37.503827 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Image pref 0:0:0 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 12:43:37.504299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.virt.hardware [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127299) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 12:43:37.513643 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:37.514118 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:37.514544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:37.515259 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:37.515702 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:37.516113 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:37.537883 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Getting quotas for project e112083132a9492089fafdae9e34f4ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 12:43:37.542369 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.quota [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Getting quotas for user ae1cd97c879141e2b4c1527b5964d054 and project e112083132a9492089fafdae9e34f4ff. Resources: {'ram', 'cores', 'instances'} {{(pid=127299) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 12:43:37.603171 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Going to run 1 instances... {{(pid=127299) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 12:43:37.605374 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43bf92c1-ddd9-4dc4-8956-c63483308b31',volume_size=None,volume_type=None)] {{(pid=127299) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 12:43:37.750412 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-ea53493d-c8da-4923-8e2d-075f22fe173a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.427900 Aug 24 12:43:37.751151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 529/1050] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 12:43:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 12:43:37.762989 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3ea74e2f-176f-45db-b411-9127623be7f8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:37.763693 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3ea74e2f-176f-45db-b411-9127623be7f8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:37.822513 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3ea74e2f-176f-45db-b411-9127623be7f8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:37.829784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3ea74e2f-176f-45db-b411-9127623be7f8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1094 microversion: 2.1 time: 0.071004 Aug 24 12:43:37.830341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 522/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:37 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:38.852451 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:38.853135 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:38.860340 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:38.860862 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:38.861299 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:38.861994 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:38.862447 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:38.862865 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:38.936520 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:38.944688 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-77e0046b-9b13-4c4e-b8d4-a72b5a70bede tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1192 microversion: 2.1 time: 0.096721 Aug 24 12:43:38.945267 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 530/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:38 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:39.969313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:39.970178 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:39.979088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:39.979644 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:39.980344 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:39.980976 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:39.981448 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:39.982065 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:40.198763 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:40.207891 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e8ead063-1959-4135-80de-9e9f0e512991 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.243040 Aug 24 12:43:40.208478 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 523/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:39 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:40.526924 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-fcfe5cb0-0dcb-478a-9077-3ba359e14d4c req-279db0e1-3b4b-4cd0-a3c4-09abee477516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5211dced-47dd-43fe-b2e5-ae5228d35778", "tag": "8f89f8a9-b411-4889-9680-30b9d2209d44"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:40.537535 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-fcfe5cb0-0dcb-478a-9077-3ba359e14d4c req-279db0e1-3b4b-4cd0-a3c4-09abee477516 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:40.538017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-fcfe5cb0-0dcb-478a-9077-3ba359e14d4c req-279db0e1-3b4b-4cd0-a3c4-09abee477516 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:40.538462 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-fcfe5cb0-0dcb-478a-9077-3ba359e14d4c req-279db0e1-3b4b-4cd0-a3c4-09abee477516 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:40.549851 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-fcfe5cb0-0dcb-478a-9077-3ba359e14d4c req-279db0e1-3b4b-4cd0-a3c4-09abee477516 service nova] Creating event network-changed:8f89f8a9-b411-4889-9680-30b9d2209d44 for instance 5211dced-47dd-43fe-b2e5-ae5228d35778 on hv-cinder-84605 Aug 24 12:43:40.554854 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-fcfe5cb0-0dcb-478a-9077-3ba359e14d4c req-279db0e1-3b4b-4cd0-a3c4-09abee477516 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102832 Aug 24 12:43:40.555448 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 531/1054] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 12:43:41.229360 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:41.229921 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:41.236809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:41.237296 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:41.237758 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:41.238453 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:41.238905 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:41.239337 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:41.460249 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:41.470819 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-871e3791-70fd-40b5-9de7-5f775657ff61 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.245155 Aug 24 12:43:41.471591 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 524/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:41 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:42.501072 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:42.502405 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:42.514022 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:42.514795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:42.515512 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:42.516636 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:42.517138 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:42.517565 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:42.671911 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:42.680272 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5cf8a08f-022b-4cb5-8406-37b1f1820fc1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.186489 Aug 24 12:43:42.680870 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 532/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:42 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:43.711054 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:43.712215 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:43.721915 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:43.722434 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:43.722903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:43.723601 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:43.724067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:43.724493 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:43.889192 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:43.902093 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-033eb5db-2e75-4427-a197-7362f941d1c2 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.198435 Aug 24 12:43:43.902854 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 525/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:43 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:44.926465 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:44.927098 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:44.929878 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:44.935795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:44.936214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:44.936660 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:44.937353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:44.937796 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:44.938211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:44.941802 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=75 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:45.080497 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:45.089218 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-518e0610-8107-4489-b4a1-26d9a7e38e3b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.168294 Aug 24 12:43:45.090024 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 533/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:44 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:46.115341 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:46.116288 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:46.120102 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=35 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:46.128668 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:46.129155 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:46.129582 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:46.130268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:46.130740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:46.131158 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:46.133880 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=71 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:46.270575 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:46.278944 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8e9d5880-506b-49c8-9efc-5148905c255a tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.170563 Aug 24 12:43:46.279524 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 526/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:46 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:47.305406 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:47.306372 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:47.317561 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:47.318047 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:47.318473 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:47.319160 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:47.319603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:47.320016 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:47.466050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:47.474607 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-110cb0f9-72e3-4c98-8d61-b90af0a425e7 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.176109 Aug 24 12:43:47.475180 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 534/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:47 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:48.496643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:48.497388 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:48.501091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:48.509057 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:48.509781 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:48.510404 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:48.511363 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:48.511994 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:48.512607 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:48.650808 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:48.659937 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8d89c693-0de0-4535-8322-78d8b166fa76 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.167384 Aug 24 12:43:48.660551 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 527/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:48 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:49.683310 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:49.684043 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:49.686350 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:49.687003 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell0:SELECT=6 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:43:49.694021 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:49.694519 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:49.694950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:49.695641 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:49.696090 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:49.696505 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:49.844589 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:49.853919 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-49f6951d-2761-47a3-89d4-0036fc521ccf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.176078 Aug 24 12:43:49.854494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 535/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:49 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:50.137875 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-a411794d-f93d-4077-ac06-90130ee1dff3 req-1ed554f7-fe63-4184-ad17-f21b3db8a321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5211dced-47dd-43fe-b2e5-ae5228d35778", "name": "network-vif-plugged", "status": "completed", "tag": "8f89f8a9-b411-4889-9680-30b9d2209d44"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:50.148763 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a411794d-f93d-4077-ac06-90130ee1dff3 req-1ed554f7-fe63-4184-ad17-f21b3db8a321 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:50.149135 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a411794d-f93d-4077-ac06-90130ee1dff3 req-1ed554f7-fe63-4184-ad17-f21b3db8a321 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:50.149565 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a411794d-f93d-4077-ac06-90130ee1dff3 req-1ed554f7-fe63-4184-ad17-f21b3db8a321 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:50.161018 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-a411794d-f93d-4077-ac06-90130ee1dff3 req-1ed554f7-fe63-4184-ad17-f21b3db8a321 service nova] Creating event network-vif-plugged:8f89f8a9-b411-4889-9680-30b9d2209d44 for instance 5211dced-47dd-43fe-b2e5-ae5228d35778 on hv-cinder-84605 Aug 24 12:43:50.165969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-a411794d-f93d-4077-ac06-90130ee1dff3 req-1ed554f7-fe63-4184-ad17-f21b3db8a321 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090503 Aug 24 12:43:50.166553 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 528/1063] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:43:50.879033 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:50.880245 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:50.890907 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:50.891735 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:50.892441 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:50.893659 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:50.894544 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:50.894986 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:51.032754 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:51.041073 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bc51e6f2-07af-4a02-9a7a-ff8b991bd454 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1266 microversion: 2.1 time: 0.168643 Aug 24 12:43:51.041637 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 536/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:50 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:52.066832 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:52.067531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:52.074285 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:52.074782 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:52.075209 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:52.075985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:52.076396 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:52.076888 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:52.224623 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:52.232635 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c566bda7-2886-4d9c-a37c-26eafa5dce71 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1453 microversion: 2.1 time: 0.173438 Aug 24 12:43:52.233212 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 529/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:52 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:52.256018 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:43:52.256706 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:43:52.265710 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:52.266321 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:52.266921 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:52.267962 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:52.268587 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:52.269249 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:52.402074 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:43:52.414349 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-56a4ecd6-27b2-40c7-bcb6-e3407e6f8ac1 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1453 microversion: 2.1 time: 0.163508 Aug 24 12:43:52.415269 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 537/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:43:52 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:43:54.282870 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-45ff3b86-708d-43a8-b67b-ee7efe9c66fa req-b90026d4-a4e1-42ba-a202-c0bd1c2957c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5211dced-47dd-43fe-b2e5-ae5228d35778", "tag": "8f89f8a9-b411-4889-9680-30b9d2209d44"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:43:54.294035 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-45ff3b86-708d-43a8-b67b-ee7efe9c66fa req-b90026d4-a4e1-42ba-a202-c0bd1c2957c6 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:43:54.294633 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-45ff3b86-708d-43a8-b67b-ee7efe9c66fa req-b90026d4-a4e1-42ba-a202-c0bd1c2957c6 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:43:54.295144 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-45ff3b86-708d-43a8-b67b-ee7efe9c66fa req-b90026d4-a4e1-42ba-a202-c0bd1c2957c6 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:43:54.307519 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-45ff3b86-708d-43a8-b67b-ee7efe9c66fa req-b90026d4-a4e1-42ba-a202-c0bd1c2957c6 service nova] Creating event network-changed:8f89f8a9-b411-4889-9680-30b9d2209d44 for instance 5211dced-47dd-43fe-b2e5-ae5228d35778 on hv-cinder-84605 Aug 24 12:43:54.312681 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-45ff3b86-708d-43a8-b67b-ee7efe9c66fa req-b90026d4-a4e1-42ba-a202-c0bd1c2957c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033520 Aug 24 12:43:54.313734 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 530/1067] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:44:42.026229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:44:42.026890 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Wed Aug 24 12:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:45:33.713017 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=9 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:33.713762 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=29 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:33.717975 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:33.718500 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:33.725400 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:33.725917 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:33.726377 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:33.727219 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:33.727671 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:33.728093 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:33.752385 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.objects.instance [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lazy-loading 'flavor' on Instance uuid b850f9b1-6213-4060-965e-203ae165fe96 {{(pid=127299) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:45:33.833204 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f61d06dc-6423-4d50-a263-c7dd7e75f12d tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "POST /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96/action" status: 202 len: 0 microversion: 2.1 time: 0.121748 Aug 24 12:45:33.833801 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 538/1068] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:45:33 2022] POST /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:45:33.840685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=9 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:33.841474 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=21 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:33.846061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:33.846757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:33.853957 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:33.854440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:33.854917 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:33.855614 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:33.856067 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:33.856485 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:34.000325 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:34.008408 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-df6c4910-5808-4505-b9fd-6df0facd56e7 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.169851 Aug 24 12:45:34.009031 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 531/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:33 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:35.031387 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:35.032711 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:35.044685 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.045414 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.046209 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.047756 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.048231 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.049450 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.076130 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:35.076683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:35.083731 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.084218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.084718 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.085438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.085878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.086301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.112569 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:45:35.201116 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-89985937-a15f-4813-889d-17dfd3ca453c tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 204 len: 0 microversion: 2.1 time: 0.128296 Aug 24 12:45:35.204735 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 532/1070] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:45:35 2022] DELETE /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 12:45:35.212150 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:35.212985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-854cdd2f-37eb-4d42-9be0-89fefaca1277 req-fbf37977-0e79-4611-acd6-033e0b36a870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5211dced-47dd-43fe-b2e5-ae5228d35778", "tag": "8f89f8a9-b411-4889-9680-30b9d2209d44"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:35.220523 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-3e5e00ec-9b03-451b-971b-22b4a60ecfe3 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.194398 Aug 24 12:45:35.232858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 539/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:35 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:35.233091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-854cdd2f-37eb-4d42-9be0-89fefaca1277 req-fbf37977-0e79-4611-acd6-033e0b36a870 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.233091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-854cdd2f-37eb-4d42-9be0-89fefaca1277 req-fbf37977-0e79-4611-acd6-033e0b36a870 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.233091 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-854cdd2f-37eb-4d42-9be0-89fefaca1277 req-fbf37977-0e79-4611-acd6-033e0b36a870 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.233367 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:35.233367 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:35.233880 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.234375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.234812 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.235516 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:35.235969 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:35.236416 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:35.238872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-854cdd2f-37eb-4d42-9be0-89fefaca1277 req-fbf37977-0e79-4611-acd6-033e0b36a870 service nova] Creating event network-changed:8f89f8a9-b411-4889-9680-30b9d2209d44 for instance 5211dced-47dd-43fe-b2e5-ae5228d35778 on hv-cinder-84605 Aug 24 12:45:35.244113 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-854cdd2f-37eb-4d42-9be0-89fefaca1277 req-fbf37977-0e79-4611-acd6-033e0b36a870 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037834 Aug 24 12:45:35.244752 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 533/1072] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:35.369564 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:35.377663 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-274e9e4a-b905-49fa-a779-67b526db5ba4 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1578 microversion: 2.1 time: 0.155157 Aug 24 12:45:35.378284 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 540/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:35 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:36.246339 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:36.247241 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:36.255485 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:36.256086 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:36.256600 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:36.257619 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:36.258186 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:36.258716 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:36.400242 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:36.400982 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:36.408227 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:36.408758 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:36.410000 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:36.410861 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:36.411502 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:36.411916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:36.417370 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:36.426376 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5858d52a-9e2e-41af-b2e8-75e40cd568c0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.186713 Aug 24 12:45:36.426917 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 534/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:36 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:36.582214 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:36.592394 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-13652707-9e79-4120-99a6-9d1f7a250bdf tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1578 microversion: 2.1 time: 0.196663 Aug 24 12:45:36.593021 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 541/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:36 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:37.447889 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:37.448603 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:37.455571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:37.456136 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:37.456672 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:37.457436 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:37.457961 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:37.458451 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:37.613603 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:37.614353 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:37.621056 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:37.621543 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:37.621978 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:37.622680 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:37.623146 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:37.623691 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:37.665366 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:37.673616 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-37aeabaa-8fd1-4e61-ad2c-98b8cdc815e8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.229845 Aug 24 12:45:37.674229 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 535/1076] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:37 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:37.861494 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-e8f61322-c5c1-43e8-ac6b-474a63868577 req-a743bb42-f475-4ab3-a2fe-4a00185dff66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5211dced-47dd-43fe-b2e5-ae5228d35778", "name": "network-vif-deleted", "tag": "8f89f8a9-b411-4889-9680-30b9d2209d44"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:37.863510 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:37.871676 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e8f61322-c5c1-43e8-ac6b-474a63868577 req-a743bb42-f475-4ab3-a2fe-4a00185dff66 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:37.871890 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-78f9b341-c43d-4227-967d-2f84d001e7f6 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 200 len: 1459 microversion: 2.1 time: 0.262434 Aug 24 12:45:37.872312 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e8f61322-c5c1-43e8-ac6b-474a63868577 req-a743bb42-f475-4ab3-a2fe-4a00185dff66 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:37.872442 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 542/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:37 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 1459 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:37.879900 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e8f61322-c5c1-43e8-ac6b-474a63868577 req-a743bb42-f475-4ab3-a2fe-4a00185dff66 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:37.893040 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-e8f61322-c5c1-43e8-ac6b-474a63868577 req-a743bb42-f475-4ab3-a2fe-4a00185dff66 service nova] Creating event network-vif-deleted:8f89f8a9-b411-4889-9680-30b9d2209d44 for instance 5211dced-47dd-43fe-b2e5-ae5228d35778 on hv-cinder-84605 Aug 24 12:45:37.897918 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-e8f61322-c5c1-43e8-ac6b-474a63868577 req-a743bb42-f475-4ab3-a2fe-4a00185dff66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040641 Aug 24 12:45:37.898685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 536/1078] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:38.698087 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:38.698706 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:38.705559 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:38.706050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:38.706490 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:38.707185 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:38.707639 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:38.708060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:38.848734 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:38.857903 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d6189a52-6a50-4a85-a259-c02adff300f8 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.165671 Aug 24 12:45:38.858480 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 543/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:38 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:38.895611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:38.896311 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 5211dced-47dd-43fe-b2e5-ae5228d35778] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:38.903528 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:38.904016 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:38.904455 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:38.905207 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:38.905666 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:38.906094 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:38.920286 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] HTTP exception thrown: Instance 5211dced-47dd-43fe-b2e5-ae5228d35778 could not be found. Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Request method failure captured: Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 HTTP/1.1 Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhuwTf_D0-n0YPquzM4jixwvYrc-sMXo_Iw_s4siKEWI0XUrm6TYTWqLm-9FklgShytHOul0jeT2lpuATLVXJ4Ps5NTNPXA2eZw4WecCIwDREArwxOwlKDcgrVcSLETw7saygmbdUc8BJTNfYKEjIgNhgw2J8YeeTVRUgT8wj2jv4iQ Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:45:38.922319 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e112083132a9492089fafdae9e34f4ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}] Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: ae1cd97c879141e2b4c1527b5964d054 Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 5211dced-47dd-43fe-b2e5-ae5228d35778 could not be found. Aug 24 12:45:38.924063 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '5211dced-47dd-43fe-b2e5-ae5228d35778'} Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5211dced-47dd-43fe-b2e5-ae5228d35778 could not be found. Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:45:38.924985 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5211dced-47dd-43fe-b2e5-ae5228d35778 could not be found. Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5211dced-47dd-43fe-b2e5-ae5228d35778 could not be found. Aug 24 12:45:38.926359 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:38.928313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Returning 404 to user: Instance 5211dced-47dd-43fe-b2e5-ae5228d35778 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:45:38.928313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-00a079eb-7157-4404-9d2d-2268ef07224e tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778" status: 404 len: 111 microversion: 2.1 time: 0.033330 Aug 24 12:45:38.928313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 537/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:38 2022] GET /compute/v2.1/servers/5211dced-47dd-43fe-b2e5-ae5228d35778 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:45:39.879315 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:39.879944 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:39.886828 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:39.887348 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:39.887785 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:39.888466 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:39.888958 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:39.889381 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:40.033126 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:40.042618 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a69f65c6-5e9c-4b6d-94c9-ab5fddc287ef tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.167226 Aug 24 12:45:40.043401 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 544/1081] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:39 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:41.064978 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:41.065540 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:41.072397 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:41.072903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:41.073349 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:41.074055 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:41.074483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:41.074943 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:41.218367 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:41.226725 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-49f5790f-1c33-4555-841e-e602f6a59a1e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.165834 Aug 24 12:45:41.227430 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 538/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:41 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:42.058151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:42.058695 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:42.064595 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-da16405e-c8c6-44d2-93cb-759b417efb79 req-afa6cc87-e4d6-4e91-a51d-2af569d15507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aab27b4-3048-48ac-a85b-2bba4fdf2675", "tag": "fcfbb4d1-504e-43ae-aac3-8b6e8c84c917"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:42.066498 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.067224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.067850 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.068548 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.069224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.069923 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.075216 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-da16405e-c8c6-44d2-93cb-759b417efb79 req-afa6cc87-e4d6-4e91-a51d-2af569d15507 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.075846 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-da16405e-c8c6-44d2-93cb-759b417efb79 req-afa6cc87-e4d6-4e91-a51d-2af569d15507 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.076088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-da16405e-c8c6-44d2-93cb-759b417efb79 req-afa6cc87-e4d6-4e91-a51d-2af569d15507 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.091235 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-da16405e-c8c6-44d2-93cb-759b417efb79 req-afa6cc87-e4d6-4e91-a51d-2af569d15507 service nova] Creating event network-changed:fcfbb4d1-504e-43ae-aac3-8b6e8c84c917 for instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 on hv-cinder-84605 Aug 24 12:45:42.097328 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-da16405e-c8c6-44d2-93cb-759b417efb79 req-afa6cc87-e4d6-4e91-a51d-2af569d15507 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036797 Aug 24 12:45:42.098416 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 539/1083] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:42.116538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Going to try to terminate instance {{(pid=127299) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:45:42.213613 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e37820ab-df70-4242-9497-edb6454b74d8 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 204 len: 0 microversion: 2.1 time: 0.159076 Aug 24 12:45:42.217627 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 545/1084] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:45:42 2022] DELETE /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:45:42.225010 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:42.225707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:42.232269 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.232787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.233218 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.233908 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.234354 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.234767 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.247867 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:42.248560 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:42.254933 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.255418 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.255843 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.256541 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:42.257014 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:42.257513 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:42.771683 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:42.775658 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:42.779740 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1e44c701-3852-4fb9-8a40-c6b6e3bbda64 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1576 microversion: 2.1 time: 0.559914 Aug 24 12:45:42.780317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 540/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:42 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1576 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:42.794228 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0d63bbe0-13d1-47d4-a2ac-295d69dc29e0 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.550515 Aug 24 12:45:42.795781 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 546/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:42 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:45:43.802146 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:43.802789 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:43.810816 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:43.811339 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:43.811779 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:43.812925 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:43.813422 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:43.813898 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:43.821250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:43.822060 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:43.828585 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:43.829109 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:43.829557 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:43.830281 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:43.830734 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:43.831151 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:44.009360 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:44.018118 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-10e703ba-f7b9-49d2-8873-f0532af8eb88 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1576 microversion: 2.1 time: 0.219877 Aug 24 12:45:44.018586 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 541/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:43 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:44.057309 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:44.065324 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-08c26c96-c307-4050-b7f0-ab3c31b7202e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.251477 Aug 24 12:45:44.066097 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 547/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:43 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:45.040061 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:45.041379 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:45.049596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:45.050133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:45.050569 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:45.051342 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:45.051804 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:45.052230 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:45.087381 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:45.088108 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:45.102493 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:45.103099 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:45.103882 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:45.104640 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:45.105119 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:45.105599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:45.160737 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:45.170142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b9a33df1-a83d-4929-812e-6daaa65e43ce tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1390 microversion: 2.1 time: 0.134375 Aug 24 12:45:45.170739 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 542/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:45 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1390 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:45.219903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-f6bf3831-764c-4681-81b0-81baf184e78b req-bc829798-2a08-4695-86a2-2594751b170a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aab27b4-3048-48ac-a85b-2bba4fdf2675", "name": "network-vif-deleted", "tag": "fcfbb4d1-504e-43ae-aac3-8b6e8c84c917"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:45.230646 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f6bf3831-764c-4681-81b0-81baf184e78b req-bc829798-2a08-4695-86a2-2594751b170a service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:45.231142 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f6bf3831-764c-4681-81b0-81baf184e78b req-bc829798-2a08-4695-86a2-2594751b170a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:45.231585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f6bf3831-764c-4681-81b0-81baf184e78b req-bc829798-2a08-4695-86a2-2594751b170a service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:45.244784 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-f6bf3831-764c-4681-81b0-81baf184e78b req-bc829798-2a08-4695-86a2-2594751b170a service nova] Creating event network-vif-deleted:fcfbb4d1-504e-43ae-aac3-8b6e8c84c917 for instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 on hv-cinder-84605 Aug 24 12:45:45.249885 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-f6bf3831-764c-4681-81b0-81baf184e78b req-bc829798-2a08-4695-86a2-2594751b170a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033788 Aug 24 12:45:45.250582 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 543/1090] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:45:45.302709 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:45.314626 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a04a4051-8dfc-46ec-9394-0af16fb1383b tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.230836 Aug 24 12:45:45.315370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 548/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:45 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:46.194106 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:46.194872 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:46.202510 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:46.203009 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:46.203449 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:46.204152 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:46.204611 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:46.205079 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:46.281954 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:46.290202 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-92904aa4-1ca3-467b-baf9-9a06e232721b tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1390 microversion: 2.1 time: 0.101546 Aug 24 12:45:46.290743 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 544/1092] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:46 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1390 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:46.337972 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:46.338563 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:46.345538 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:46.346026 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:46.346456 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:46.347150 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:46.347599 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:46.348019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:46.487132 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:46.497096 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-4b52c959-3815-49ba-beed-5bc665327f45 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.163063 Aug 24 12:45:46.497667 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 549/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:46 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:47.313483 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:47.314655 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:47.321701 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:47.322185 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:47.322613 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:47.323340 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:47.323787 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:47.324204 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:47.357685 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:47.358175 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:47.358615 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:47.359052 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lazy-loading 'fault' on Instance uuid 2aab27b4-3048-48ac-a85b-2bba4fdf2675 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:45:47.402217 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1cd97c879141e2b4c1527b5964d054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e112083132a9492089fafdae9e34f4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:47.409793 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e3ed8dd5-aa0c-4aa4-b6b1-cf13ccf07637 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 200 len: 1184 microversion: 2.1 time: 0.101165 Aug 24 12:45:47.410351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 545/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:47 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 1184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:47.518370 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:47.518960 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:47.525463 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:47.525935 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:47.526358 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:47.527023 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:47.527463 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:47.527905 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:47.670540 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:47.674612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:47.679469 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a84c6242-f7df-43eb-975e-e41a5f21c131 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.165207 Aug 24 12:45:47.680073 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 550/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:47 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:45:48.431598 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:48.432227 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 2aab27b4-3048-48ac-a85b-2bba4fdf2675] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:48.439197 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.439694 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.441181 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.441899 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.442385 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.443436 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.459431 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] HTTP exception thrown: Instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 could not be found. Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Request method failure captured: Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 HTTP/1.1 Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Connection: close Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Host: 10.222.0.27 Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABjBhuwTf_D0-n0YPquzM4jixwvYrc-sMXo_Iw_s4siKEWI0XUrm6TYTWqLm-9FklgShytHOul0jeT2lpuATLVXJ4Ps5NTNPXA2eZw4WecCIwDREArwxOwlKDcgrVcSLETw7saygmbdUc8BJTNfYKEjIgNhgw2J8YeeTVRUgT8wj2jv4iQ Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Role: reader,member Aug 24 12:45:48.461114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Roles: reader,member Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e112083132a9492089fafdae9e34f4ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}] Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Id: ae1cd97c879141e2b4c1527b5964d054 Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: method: > Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: exception: Instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 could not be found. Aug 24 12:45:48.462675 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: action_args: {'id': '2aab27b4-3048-48ac-a85b-2bba4fdf2675'} Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 could not be found. Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:45:48.463538 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 could not be found. Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 could not be found. Aug 24 12:45:48.465104 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 24 12:45:48.466313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Returning 404 to user: Instance 2aab27b4-3048-48ac-a85b-2bba4fdf2675 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:45:48.466313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-43798a7f-5cc3-4b9f-8a56-681d991ac2bc tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675" status: 404 len: 111 microversion: 2.1 time: 0.035285 Aug 24 12:45:48.466313 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 546/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:48 2022] GET /compute/v2.1/servers/2aab27b4-3048-48ac-a85b-2bba4fdf2675 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:45:48.701443 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:48.702029 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:48.709749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.710235 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.710665 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.711375 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.711825 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.712250 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.895200 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:48.904327 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-c2961856-e8dd-43e4-b779-d76d9560568c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1510 microversion: 2.1 time: 0.207131 Aug 24 12:45:48.905004 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 551/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:48 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:48.925733 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:48.926336 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:48.932440 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.932958 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.934352 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:48.934939 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:48.935705 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:48.936378 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.006487 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:49.007168 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:49.016413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.017061 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.017504 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.018224 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.018684 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.019111 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.032760 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127298) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 12:45:49.033719 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] HTTP exception thrown: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Request method failure captured: Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: DELETE /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df HTTP/1.1 Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhuwTf_D0-n0YPquzM4jixwvYrc-sMXo_Iw_s4siKEWI0XUrm6TYTWqLm-9FklgShytHOul0jeT2lpuATLVXJ4Ps5NTNPXA2eZw4WecCIwDREArwxOwlKDcgrVcSLETw7saygmbdUc8BJTNfYKEjIgNhgw2J8YeeTVRUgT8wj2jv4iQ Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:45:49.035392 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e112083132a9492089fafdae9e34f4ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}] Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: ae1cd97c879141e2b4c1527b5964d054 Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.036943 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df'} Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:45:49.038415 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.039979 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.041885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Returning 404 to user: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:45:49.041885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-02213925-4d46-4d12-9b89-6867a0fe8927 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 404 len: 111 microversion: 2.1 time: 0.034323 Aug 24 12:45:49.041885 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 552/1098] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:45:48 2022] DELETE /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:45:49.045446 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:49.046456 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [instance: 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:49.052846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.053331 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.053757 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.054450 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.054898 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.055317 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.069070 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] HTTP exception thrown: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Request method failure captured: Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df HTTP/1.1 Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhuwTf_D0-n0YPquzM4jixwvYrc-sMXo_Iw_s4siKEWI0XUrm6TYTWqLm-9FklgShytHOul0jeT2lpuATLVXJ4Ps5NTNPXA2eZw4WecCIwDREArwxOwlKDcgrVcSLETw7saygmbdUc8BJTNfYKEjIgNhgw2J8YeeTVRUgT8wj2jv4iQ Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:45:49.070597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e112083132a9492089fafdae9e34f4ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e112083132a9492089fafdae9e34f4ff"}]}] Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: e112083132a9492089fafdae9e34f4ff Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800269623 Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: ae1cd97c879141e2b4c1527b5964d054 Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-TestVolumeBootPattern-1800269623-project Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.072341 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': '0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df'} Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:45:49.073950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. Aug 24 12:45:49.075625 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:45:49.077148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Returning 404 to user: Instance 0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:45:49.077148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-a8607ff7-bf76-49df-be37-5a7b88d0c776 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df" status: 404 len: 111 microversion: 2.1 time: 0.030210 Aug 24 12:45:49.077148 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 553/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:49 2022] GET /compute/v2.1/servers/0ba9a8b1-91ed-44b5-8a1b-ab46bd8c76df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:45:49.110892 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fcef3726-4072-4921-9767-c7b35fb5d80e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "POST /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96/action" status: 202 len: 0 microversion: 2.1 time: 0.189265 Aug 24 12:45:49.112690 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 547/1100] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 12:45:48 2022] POST /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:45:49.119849 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:49.120457 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:49.127202 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.127711 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.128136 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.129011 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:49.129481 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:49.129869 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:49.276858 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:49.286015 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-9b5728d4-fb25-4022-8184-fa7e1e3110ae tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1518 microversion: 2.1 time: 0.170349 Aug 24 12:45:49.286594 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 554/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:49 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:50.308114 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:50.308710 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:50.315998 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.316475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.316941 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.317639 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.318094 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.318516 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.339757 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:45:50.444195 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-5cf1eefe-4354-4ea5-a982-d47228676642 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] Calling method '.version_select at 0x7fa676ddaf70>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:50.449045 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cf1eefe-4354-4ea5-a982-d47228676642 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [4cb40179-75ed-4e4c-8be7-74122cd3ea25] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 12:45:50.482670 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:50.490776 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-94dea675-b287-4db4-98f3-5c8c819d42d4 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1520 microversion: 2.1 time: 0.187146 Aug 24 12:45:50.491349 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 548/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:50 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:50.642967 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-4ae54e8a-8694-4cc7-a317-c26cf2b28aea req-d75a510f-699b-4923-bc6b-b891b76a5e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b850f9b1-6213-4060-965e-203ae165fe96", "name": "network-vif-unplugged", "status": "completed", "tag": "dd9b8d4c-fd29-42e9-9724-26157f9ef99e"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:45:50.652571 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-4ae54e8a-8694-4cc7-a317-c26cf2b28aea req-d75a510f-699b-4923-bc6b-b891b76a5e79 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:50.653182 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-4ae54e8a-8694-4cc7-a317-c26cf2b28aea req-d75a510f-699b-4923-bc6b-b891b76a5e79 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:50.653795 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-4ae54e8a-8694-4cc7-a317-c26cf2b28aea req-d75a510f-699b-4923-bc6b-b891b76a5e79 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:50.665488 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.compute.server_external_events [req-4ae54e8a-8694-4cc7-a317-c26cf2b28aea req-d75a510f-699b-4923-bc6b-b891b76a5e79 service nova] Unable to find a host for instance b850f9b1-6213-4060-965e-203ae165fe96. Dropping event network-vif-unplugged {{(pid=127298) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 12:45:50.666375 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-4ae54e8a-8694-4cc7-a317-c26cf2b28aea req-d75a510f-699b-4923-bc6b-b891b76a5e79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027386 Aug 24 12:45:50.666969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 549/1103] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 12:45:51.457730 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cf1eefe-4354-4ea5-a982-d47228676642 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] [4cb40179-75ed-4e4c-8be7-74122cd3ea25] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 37958. Aug 24 12:45:51.480633 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-5cf1eefe-4354-4ea5-a982-d47228676642 tempest-TestVolumeBootPattern-1800269623 tempest-TestVolumeBootPattern-1800269623-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1671158803" status: 202 len: 0 microversion: 2.1 time: 1.040682 Aug 24 12:45:51.481257 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 555/1104] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Aug 24 12:45:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1671158803 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 12:45:51.514269 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:51.515268 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:51.522986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:51.523478 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:51.524372 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:51.525133 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:51.525585 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:51.526317 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:51.735895 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:51.744274 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-02486d42-12e7-47ea-9cb1-cc30539df260 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.234172 Aug 24 12:45:51.745071 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 550/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:51 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:52.766547 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:52.767019 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:52.774054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:52.774556 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:52.775049 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:52.775972 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:52.776430 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:52.777172 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:52.933741 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:52.942528 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-0b9774fb-cfe3-4394-a4bc-08e0edda8d69 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.180825 Aug 24 12:45:52.943710 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 556/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:52 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:53.964687 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:53.965553 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:53.973469 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:53.974171 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:53.974765 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:53.975773 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:53.976395 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:53.977001 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:54.211826 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:54.220596 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-80390704-36dd-4cce-8c0e-4531dff75b41 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.259866 Aug 24 12:45:54.221245 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 551/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:53 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:55.245698 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:55.246846 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:55.260013 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:55.260950 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:55.261748 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:55.262775 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:55.263509 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:55.263951 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:55.757597 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:55.767434 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-f6fd9ebd-5bb7-4e6f-8dcc-ae07e1e7d780 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.529493 Aug 24 12:45:55.780821 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 557/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:55 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:56.791763 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:56.797157 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:56.807117 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:56.807821 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:56.808454 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:56.809351 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:56.810042 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:56.810632 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:57.036075 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:57.044173 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ac7e1bfd-1eeb-44c1-bfc3-199b5c892811 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.258394 Aug 24 12:45:57.044809 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 552/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:56 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:45:58.066764 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:58.067413 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:58.074211 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:58.074711 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:58.075128 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:58.075893 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:58.076860 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:58.077465 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:58.289913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:58.298814 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-d233a1d2-7e76-4711-9f33-fdd5ec918d8c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.235909 Aug 24 12:45:58.299494 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 558/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:58 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 12:45:59.319975 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:45:59.321439 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:45:59.328457 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:59.329403 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:59.329822 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:59.330903 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:45:59.331563 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:45:59.332276 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:45:59.476747 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:45:59.485122 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-eff834a7-d8a4-4290-b0b9-0f6c2afea248 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.169264 Aug 24 12:45:59.485719 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 553/1111] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:45:59 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:46:00.507192 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:00.507762 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:00.515132 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:00.515612 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:00.516048 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:00.516838 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:00.517225 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:00.517927 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:00.659916 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:46:00.667863 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-e3951ade-7ae3-43e8-a882-457199ebd242 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.164678 Aug 24 12:46:00.668432 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 559/1112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:46:00 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:46:00.726387 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-96d2b0da-db1d-440e-bbd2-1d3cc65f8656 req-052390b9-e7be-4e97-a918-a5f64284f2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b850f9b1-6213-4060-965e-203ae165fe96", "name": "network-vif-plugged", "status": "completed", "tag": "dd9b8d4c-fd29-42e9-9724-26157f9ef99e"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:46:00.738242 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-96d2b0da-db1d-440e-bbd2-1d3cc65f8656 req-052390b9-e7be-4e97-a918-a5f64284f2d3 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:00.739029 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-96d2b0da-db1d-440e-bbd2-1d3cc65f8656 req-052390b9-e7be-4e97-a918-a5f64284f2d3 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:00.739316 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-96d2b0da-db1d-440e-bbd2-1d3cc65f8656 req-052390b9-e7be-4e97-a918-a5f64284f2d3 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:00.752301 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-96d2b0da-db1d-440e-bbd2-1d3cc65f8656 req-052390b9-e7be-4e97-a918-a5f64284f2d3 service nova] Creating event network-vif-plugged:dd9b8d4c-fd29-42e9-9724-26157f9ef99e for instance b850f9b1-6213-4060-965e-203ae165fe96 on hv-cinder-84605 Aug 24 12:46:00.757749 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-96d2b0da-db1d-440e-bbd2-1d3cc65f8656 req-052390b9-e7be-4e97-a918-a5f64284f2d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035041 Aug 24 12:46:00.758331 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 554/1113] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:46:01.690127 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:01.690724 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:01.698050 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:01.698570 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:01.699053 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:01.699776 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:01.700254 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:01.700717 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:01.847459 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:46:01.855651 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-fedd793f-7cfa-43e6-9d7a-32d9da3d6a22 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1576 microversion: 2.1 time: 0.170087 Aug 24 12:46:01.856238 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 560/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:46:01 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:46:02.877531 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:46:02.878198 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:46:02.885288 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:02.885775 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:02.886205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:02.886893 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:46:02.887345 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:46:02.887786 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:46:03.057159 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:46:03.065986 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-20b6d34a-c5bf-4c8f-8168-730aebaf018c tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1563 microversion: 2.1 time: 0.192683 Aug 24 12:46:03.066729 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 555/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:46:02 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:46:08.935911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:46:08.937049 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Wed Aug 24 12:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:46:17.191608 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:46:17.192424 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Wed Aug 24 12:46:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:47:19.271618 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:19.272410 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=36 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:19.276406 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-1bd04db4-735f-41c9-b2d3-c0ac18a60a96 req-c90bbdef-9295-4572-94c4-1819a57c5d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b850f9b1-6213-4060-965e-203ae165fe96", "tag": "dd9b8d4c-fd29-42e9-9724-26157f9ef99e"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:47:19.277655 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:19.278716 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG dbcounter [-] [127299] Writing DB stats nova_cell1:SELECT=46 {{(pid=127299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:47:19.283419 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:19.283913 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:19.295650 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1bd04db4-735f-41c9-b2d3-c0ac18a60a96 req-c90bbdef-9295-4572-94c4-1819a57c5d3f service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:19.296205 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1bd04db4-735f-41c9-b2d3-c0ac18a60a96 req-c90bbdef-9295-4572-94c4-1819a57c5d3f service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:19.301499 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1bd04db4-735f-41c9-b2d3-c0ac18a60a96 req-c90bbdef-9295-4572-94c4-1819a57c5d3f service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:19.303999 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:19.304491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:19.304951 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:19.305683 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:19.306116 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:19.306553 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:19.316865 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-1bd04db4-735f-41c9-b2d3-c0ac18a60a96 req-c90bbdef-9295-4572-94c4-1819a57c5d3f service nova] Creating event network-changed:dd9b8d4c-fd29-42e9-9724-26157f9ef99e for instance b850f9b1-6213-4060-965e-203ae165fe96 on hv-cinder-84605 Aug 24 12:47:19.322792 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-1bd04db4-735f-41c9-b2d3-c0ac18a60a96 req-c90bbdef-9295-4572-94c4-1819a57c5d3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052434 Aug 24 12:47:19.323650 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 556/1116] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:19.334623 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Going to try to terminate instance {{(pid=127299) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 12:47:19.432928 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-016c713f-2da7-4da4-a542-c77f424f19ab tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 204 len: 0 microversion: 2.1 time: 0.164732 Aug 24 12:47:19.433322 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 561/1117] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 12:47:19 2022] DELETE /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 12:47:19.442489 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:19.443180 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:19.449394 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:19.449878 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:19.450321 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:19.451022 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:19.451475 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:19.451901 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:19.589069 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:47:19.597233 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7db132b2-3b07-4774-b1ad-909965cef580 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.158941 Aug 24 12:47:19.597803 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 557/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:47:19 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:47:20.624567 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:20.625795 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:20.636290 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:20.637136 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:20.637857 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:20.639054 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:20.639863 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:20.640472 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:20.854805 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.policy [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127299) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:47:20.863317 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-6c127998-c2b8-4439-bcf7-b5284d09a211 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.246469 Aug 24 12:47:20.863889 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 562/1119] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:47:20 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:47:21.885119 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:21.886473 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:21.894421 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:21.894917 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:21.895352 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:21.896060 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:21.896514 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:21.896969 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:22.187115 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:47:22.195438 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bedb36b0-f337-4303-bd59-7cf4534efad9 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1569 microversion: 2.1 time: 0.314201 Aug 24 12:47:22.195988 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 558/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:47:21 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1569 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:47:22.381533 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [req-1c4c2861-4fa3-4f47-87cc-932e5e0159c3 req-0569f9d6-93f6-4fb7-bd14-271488345645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b850f9b1-6213-4060-965e-203ae165fe96", "name": "network-vif-deleted", "tag": "dd9b8d4c-fd29-42e9-9724-26157f9ef99e"}]} {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 12:47:22.392206 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-1c4c2861-4fa3-4f47-87cc-932e5e0159c3 req-0569f9d6-93f6-4fb7-bd14-271488345645 service nova] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:22.392720 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-1c4c2861-4fa3-4f47-87cc-932e5e0159c3 req-0569f9d6-93f6-4fb7-bd14-271488345645 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:22.393156 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [req-1c4c2861-4fa3-4f47-87cc-932e5e0159c3 req-0569f9d6-93f6-4fb7-bd14-271488345645 service nova] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:22.404263 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.compute.server_external_events [req-1c4c2861-4fa3-4f47-87cc-932e5e0159c3 req-0569f9d6-93f6-4fb7-bd14-271488345645 service nova] Creating event network-vif-deleted:dd9b8d4c-fd29-42e9-9724-26157f9ef99e for instance b850f9b1-6213-4060-965e-203ae165fe96 on hv-cinder-84605 Aug 24 12:47:22.410142 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [req-1c4c2861-4fa3-4f47-87cc-932e5e0159c3 req-0569f9d6-93f6-4fb7-bd14-271488345645 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Aug 24 12:47:22.410744 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 563/1121] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 12:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 12:47:23.217291 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:23.217836 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:23.225430 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:23.226004 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:23.226493 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:23.227236 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:23.227707 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:23.228216 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:23.263507 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:23.263984 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:23.264430 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:23.264911 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lazy-loading 'fault' on Instance uuid b850f9b1-6213-4060-965e-203ae165fe96 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 12:47:23.312183 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e6fd8802348b988baaa181ee163da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176f865ce7f542f4a7af595b17e2324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 12:47:23.321088 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c3bac8d3-67f2-4435-a61c-1686962b594e tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 200 len: 1224 microversion: 2.1 time: 0.107821 Aug 24 12:47:23.321643 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 559/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:47:23 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 12:47:24.346702 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '>' {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:24.347636 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.compute.api [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] [instance: b850f9b1-6213-4060-965e-203ae165fe96] Fetching instance by UUID {{(pid=127299) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 12:47:24.356550 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:24.357239 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:24.357814 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:24.358742 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Acquiring lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 12:47:24.359345 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 12:47:24.359914 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG oslo_concurrency.lockutils [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Lock "532fa35e-2ad6-4d7d-873f-2d1aef2f8ed1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 12:47:24.374425 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.wsgi [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] HTTP exception thrown: Instance b850f9b1-6213-4060-965e-203ae165fe96 could not be found. Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Request method failure captured: Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: request: GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 HTTP/1.1 Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept: application/json Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Accept-Encoding: identity Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Connection: close Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Length: 0 Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Content-Type: application/json Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Host: 10.222.0.27 Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Openstack-System-Scope: None Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: User-Agent: python-urllib3/1.26.11 Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Auth-Token: gAAAAABjBhzHCYJKvhItVQi0At6vc-h4sx3BGLuxloPsxbEX2OWdAwoAHyiAb7nH4n-J-d9XYRMmBi1t4pvhrOX0stKW8bZZhBHOxEA5IVaeMlE4JZXoETUNIEzc21Us8MMdJ4xDuIIFWal7_axKTcyXb3m_6rIzTPzz6yiOdBPWXDWVIlmI2tE Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Id: None Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Domain-Name: None Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Identity-Status: Confirmed Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Is-Admin-Project: True Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Id: default Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Domain-Name: Default Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Id: 176f865ce7f542f4a7af595b17e2324a Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Project-Name: tempest-TestShelveInstance-983041807 Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Role: reader,member Aug 24 12:47:24.376491 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Roles: reader,member Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/176f865ce7f542f4a7af595b17e2324a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_176f865ce7f542f4a7af595b17e2324a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/176f865ce7f542f4a7af595b17e2324a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/176f865ce7f542f4a7af595b17e2324a"}]}] Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant: tempest-TestShelveInstance-983041807 Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Id: 176f865ce7f542f4a7af595b17e2324a Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-Tenant-Name: tempest-TestShelveInstance-983041807 Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User: tempest-TestShelveInstance-983041807-project Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Id: default Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Domain-Name: Default Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Id: 057e6fd8802348b988baaa181ee163da Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: X-User-Name: tempest-TestShelveInstance-983041807-project Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: method: > Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: exception: Instance b850f9b1-6213-4060-965e-203ae165fe96 could not be found. Aug 24 12:47:24.378362 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: action_args: {'id': 'b850f9b1-6213-4060-965e-203ae165fe96'} Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: {{(pid=127299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b850f9b1-6213-4060-965e-203ae165fe96 could not be found. Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 12:47:24.379276 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b850f9b1-6213-4060-965e-203ae165fe96 could not be found. Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b850f9b1-6213-4060-965e-203ae165fe96 could not be found. Aug 24 12:47:24.380749 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: ERROR nova.api.openstack.wsgi Aug 24 12:47:24.382043 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: DEBUG nova.api.openstack.wsgi [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Returning 404 to user: Instance b850f9b1-6213-4060-965e-203ae165fe96 could not be found. {{(pid=127299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 12:47:24.382043 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO nova.api.openstack.requestlog [None req-bf2e5690-d3f5-493d-9149-dd226486cd48 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96" status: 404 len: 111 microversion: 2.1 time: 0.037547 Aug 24 12:47:24.382043 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: [pid: 127299|app: 0|req: 564/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 12:47:24 2022] GET /compute/v2.1/servers/b850f9b1-6213-4060-965e-203ae165fe96 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 12:47:24.550248 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-07d43649-6916-4a21-a3fd-ee3053e5ef55 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] Calling method '.version_select at 0x7fa676b67dc0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 12:47:24.579365 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-07d43649-6916-4a21-a3fd-ee3053e5ef55 tempest-TestShelveInstance-983041807 tempest-TestShelveInstance-983041807-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1974212249" status: 202 len: 0 microversion: 2.1 time: 0.033684 Aug 24 12:47:24.580138 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 560/1124] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Aug 24 12:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1974212249 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 12:49:37.204810 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:49:37.205691 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Wed Aug 24 12:49:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:50:56.157338 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:50:56.158464 dv-cinder-846054-1-iscsi devstack@n-api.service[127299]: Wed Aug 24 12:50:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 12:51:22.042255 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 12:51:22.042828 dv-cinder-846054-1-iscsi devstack@n-api.service[127298]: Wed Aug 24 12:51:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!